User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

LLM inference in C/C++

Tesseract Open Source OCR Engine (main repository)

🦜🔗 The platform for reliable agents.

Inference Llama 2 in one file of pure C