Stars
Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Simple, unified interface to multiple Generative AI providers
Accessible large language models via k-bit quantization for PyTorch.
FlashInfer: Kernel Library for LLM Serving
Hackable and optimized Transformers building blocks, supporting a composable construction.
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
Large Language Model Text Generation Inference
[TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
👨💻 An awesome and curated list of best code-LLM for research.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr…
Modern concurrency for C++. Tasks, executors, timers and C++20 coroutines to rule them all
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
A coding agent for open models like Kimi K3
Zero overhead utilities for preventing bugs at compile time
Header-Only C++ Library for Graph Representation and Algorithms
The C++ Standard Library for Parallelism and Concurrency
The definitive list that answers "I want to do X in Python, which tool should I use?"
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing…