Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
-
Updated
Sep 22, 2026 - Rust
Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
Deep learning in Rust, with shape checked tensors and neural networks
Safe rust wrapper around CUDA toolkit
A machine learning library with a TypeScript API and Rust backend. CUDA and WebGPU compatibility. Built to understand how ML frameworks and models work internally.
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
Lightning: Fast data processing using GPUs on distributed platforms
Low-bit LLM inference engine in Rust + CUDA. Converts models to a 4-bit .wstone format (3.75x smaller) and runs them on consumer GPUs. Built for memory-bandwidth-bound decode on Turing, where bytes per weight — not TOPS — sets token throughput.
Weighted Jacobi stencil in Rust with cuTile CUDA
Yeet your typo's into the shadow realm before it makes it to production!
CUDA remote-exec CLI in Rust
Minimalistic llm-inference tool in Rust
To associate your repository with the cuda-kernels topic, visit your repo's landing page and select "manage topics."