Optimized primitives for collective multi-GPU communication

Supercharge Your LLM with the Fastest KV Cache Layer

SGLang is a fast serving framework for large language models and vision language models.

A streamlined and customizable framework for efficient large model evaluation and performance benchmarking

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Easily set Mac Retina display to higher unsupported resolutions