A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a fast serving framework for large language models and vision language models.

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）

A treasure chest for visual classification and recognition powered by PaddlePaddle

A Datacenter Scale Distributed Inference Serving Framework

🚀 Efficient implementations of state-of-the-art linear attention models

PaddleSlim is an open-source library for deep model compression and architecture search.

Distributed Compiler based on Triton for Parallel Systems

some interesting books