一个包含地球上所有能唱的歌的免费KTV

💌 A beautiful, fast and fully open source mail client for Mac, Windows and Linux.

Fork the Megatron Lite branch (https://github.com/ISEEKYAN/Megatron-LM/tree/lite)

LLM speculative inference server for heterogeneous hardware & consumer GPUs

NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer

Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal d…

Ever used asyncio and wished you hadn't? A tiny (~400 lines) event loop for Python.

Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.

Super fast serving stack for LLM on Windows/Linux/Macos

A single-file educational implementation for understanding vLLM's core concepts and running LLM inference.

wheels for TransformerEngine

State of the art inference performance with modern accelerators on Kubernetes

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Scalable toolkit for efficient model reinforcement

A simple Python sandbox for helpful LLM data agents

Agentic RL Training at Scale

🚴 Call stack profiler for Python. Shows you why your code is slow!

Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"

APPS: Automated Programming Progress Standard (NeurIPS 2021)

Realtime log viewer for containers. Supports Docker, Swarm and K8s.

A lightweight data processing framework built on DuckDB and 3FS.

Toolkit for linearizing PDFs for LLM datasets/training

Fast reinforcement learning 💨

A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.