Pinned Loading

1. xlite-dev/LeetCUDA xlite-dev/LeetCUDA Public

   Open-source book with Modern CUDA Learn Notes for Beginners, includes FP16/BF16, FP8, HGEMM, FlashAttention, CuTe, etc.

   Cuda 12k 1.3k

2. xlite-dev/lite.ai.toolkit xlite-dev/lite.ai.toolkit Public

   A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.

   C++ 4.4k 786

3. PaddlePaddle/FastDeploy PaddlePaddle/FastDeploy Public

   High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

   Python 3.7k 756

4. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 36.4k 9.1k

5. vipshop/cache-dit vipshop/cache-dit Public

   A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.

   Python 1.3k 89

6. xlite-dev/ffpa-attn xlite-dev/ffpa-attn Public

   Kernel Library for Large Headdim Attention (64~1024, BF16/FP8/FP4), 1.5x~15x↑ vs PyTorch SDPA.

   Python 334 27