DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.

Mixture-of-experts (MoE) training megakernel for NVL72s

An efficient service for transparent GPU multiplexing with VRAM oversubscription

C++ IPC Library

Embodied AI Operating System (EAIOS)

Flash Vision-Language-Action Inference for Autonomous Driving

分享AI Infra知识&代码练习：PyTorch、vLLM/SGLang、slime/vime框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等

Machine Learning Engineering Open Book

北京大学未名超算队与北京大学学生 Linux 俱乐部合办的暑期 AI Infra 系列活动仓库

Open Frontier Intelligence

MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts

Holistic evaluation of AI serving systems

A distributed framework for LLM agents

Production-ready MoE load balancing via real-time expert replication

A proactive on-device intelligent operating system for HarmonyOS, featuring proactive perception, autonomous decision-making, lightweight user modeling, and local LLM deployment across smartphones …

An open-source toolkit for BigMac-style pipeline-parallel training of multimodal large language models.

High-performance single-GPU inference for selected model checkpoints and GPUs.

PhyAI is a high-performance framework for running Physical AI models (VLA, WAM, and beyond), supporting both cloud-based serving and on-device deployment.

Inspect: A framework for large language model evaluations

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

Fast and memory-efficient classical machine learning operators

High-Throughput Batch Inference

TurboServe: Serving Streaming Video Generation Efficiently and Economically