Stars
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr…
LlamaIndex is the document processing platform for AI
DSPy: The framework for programming—not prompting—language models
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
An extremely fast Python type checker and language server, written in Rust.
Supercharge Your LLM Application Evaluations 🚀
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Large Language Model Text Generation Inference
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
A collection of libraries to optimise AI model performances
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
A framework for efficient model inference with omni-modality models
Build ChatGPT over your data, all with natural language
Aligning pretrained language models with instruction data generated by themselves.
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
Converts text input or URL into knowledge graph and displays
💬 RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain. Built w/ Rasa, FastAPI, Langchain, LlamaIndex, SQLModel, pgvector, ngrok, telegram
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
Deploy your agentic worfklows to production
A fully open-source, LlamaCloud-backed alternative to NotebookLM
Fast BM25 search in Python, powered by Numpy and Numba