Highlights
Stars
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
Comprehensive Hugging Face Hub Library for rust
Trainable fast and memory-efficient sparse attention
python-based eDSL for efficient Metal Shading Language code generation
CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-based computation patterns and optimizations targeting NVIDIA te…
cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.
Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
🐉 Making Rust a first-class language and ecosystem for GPU shaders 🚧
Demo project showing a single Rust codebase running on CPU and directly on GPUs
AI agents running research on single-GPU nanochat training automatically
Advanced Fuzzing Library - Slot your Fuzzer together in Rust! Scales across cores and machines. For Windows, Android, MacOS, Linux, no_std, ...
A lightweight inference engine supporting speculative speculative decoding (SSD).
Training neural networks on Apple Neural Engine via reverse-engineered private APIs
Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for Apple silicon.
Smallest transformer that can add two 10-digit numbers
A full graphical web browser for Kitty terminal with mouse and keyboard support
Stay in the loop with the Park Slope Food Coop.
A dynamic library providing Virtualization-based process isolation capabilities
Recent research papers about Foundation Models for Combinatorial Optimization
A community trust management system based on explicit vouches to participate.
Rust crate for Apple's ScreenCaptureKit
Pure C inference of Mistral Voxtral Realtime 4B speech to text model
Claude Opus 4.6 wrote a dependency-free C compiler in Rust, with backends targeting x86 (64- and 32-bit), ARM, and RISC-V, capable of compiling a booting Linux kernel.
A better wrapper for using RDMA programming APIs in Rust flavor
A sub-micrometer 3D motion control plattform.