Skip to content

zihaomu/gguf_loader

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

GGUF_loader

Provides a GGUF model loader and parser to facilitate reading llm model params from dist to memory.

It's modified from llama.cpp with tag:b4721, we removed irrelevant code and keep the interface simple.

TODO List:

- Run and pass the gguf test

  • Simplify the code and remove the ggml calculation code
  • Simplify the inferface

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors