1bit-llm

Here are 2 public repositories matching this topic...

BitNet-Stack - Run a small BitNet model on local machine with one Docker command, and chat in browser.

microsoft docker open-source query ai ml bitnet huggingface llm 1bit-llm bitnet-stack

TQ1.0 ternary inference engine for BitNet b1.58 on CPU. Pack + run Falcon3-1B/3B/7B/10B, no GPU needed.

cpp high-performance simd avx2 quantization ternary bonsai inference-engine bitnet edge-ai ternary-weights cpu-inference local-llm llm-inference falcon3 1bit-llm bitnet-b158

Add a description, image, and links to the 1bit-llm topic page so that developers can more easily learn about it.

To associate your repository with the 1bit-llm topic, visit your repo's landing page and select "manage topics."