Lists (1)
Stars
Scaling the Horizon, Not the Parameters
Ultra-light Harness scaffolding for AI agents, a mini version of claude code
Fast, small, and fully autonomous AI personal assistant infrastructure, any OS, any platform — deploy anywhere, swap anything 🦀
A security-focused library OS supporting kernel- and user-mode execution
Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
A minimal, secure Python interpreter written in Rust for use by AI
Our first fully AI generated deep learning system
LightRFT (Light Reinforcement Fine-Tuning) is an advanced reinforcement learning fine-tuning framework designed for Large Language Models (LLMs) and Vision-Language Models (VLMs).
Serverless LLM Serving for Everyone.
GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
The absolute trainer to light up AI agents.
MSCCL++: A GPU-driven communication stack for scalable AI applications
Awesome list for LLM quantization
ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Dynamic Performance Profiler for Distributed AI
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
Unified KV Cache Compression Methods for Auto-Regressive Models
[ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"
This repository contains everything you need to become proficient in System Design