Popular repositories Loading

1. vllm-fp8kv vllm-fp8kv Public

   fp8 KV-cache support for vLLM's Ampere DSA path (TRITON_MLA_SPARSE) — continues nickus/dsa-3090

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. vllm-sm120 vllm-sm120 Public

   vLLM overlay patches: native NVFP4 MoE kernels on consumer Blackwell SM120 (RTX 5090)

   Python