Stars
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Tensors and Dynamic neural networks in Python with strong GPU acceleration
A high-throughput and memory-efficient inference and serving engine for LLMs
An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
An Open Source Machine Learning Framework for Everyone
SGLang is a fast serving framework for large language models and vision language models.
The official Python SDK for Model Context Protocol servers and clients
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
A modular graph-based Retrieval-Augmented Generation (RAG) system
An open-source AI agent that brings the power of Gemini directly into your terminal.
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.
Production-ready platform for agentic workflow development.
Supercharge Your LLM Application Evaluations 🚀
C++ based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Data manipulation and transformation for audio signal processing, powered by PyTorch
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
Making large AI models cheaper, faster and more accessible
Supercharge Your LLM with the Fastest KV Cache Layer
✨✨Latest Advances on Multimodal Large Language Models
Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents