Inference Llama 2 in one file of pure C

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Universal LLM Deployment Engine with ML Compilation

High-performance In-browser LLM Inference Engine

llama and other large language models on iOS and MacOS offline using GGML library.