Skip to content

kofj/libllm

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

107 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

omni.rs: Inference library for ONMI models.

About

Efficient inference of large language models.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • C++ 84.0%
  • Cuda 10.5%
  • Rust 4.1%
  • CMake 1.4%