Starred repositories
6
stars
written in Cuda
Clear filter
A massively parallel, optimal functional runtime in Rust
FlashInfer: Kernel Library for LLM Serving
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
An extesnion for PHP allowing it to access GPU operations on CUDA graphics cards (NVIDIA)