Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.

Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

improved colored diff

Fuzzy String Matching in Python

Simple, unified interface to multiple Generative AI providers

Accessible large language models via k-bit quantization for PyTorch.

FlashInfer: Kernel Library for LLM Serving

Hackable and optimized Transformers building blocks, supporting a composable construction.

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Large Language Model Text Generation Inference

[TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.

Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

Local AI API Platform

👨‍💻 An awesome and curated list of best code-LLM for research.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr…

Modern concurrency for C++. Tasks, executors, timers and C++20 coroutines to rule them all

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

Build, run, and manage agent platforms.

Ollama Python library

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

A coding agent for open models like Kimi K3

Zero overhead utilities for preventing bugs at compile time

🍦 Never use cout/printf to debug again

Header-Only C++ Library for Graph Representation and Algorithms

The C++ Standard Library for Parallelism and Concurrency

Application Kernel for Containers

An opinionated list of Python frameworks, libraries, tools, and resources

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing…