Lists (7)
Stars
5
stars
written in Rust
Clear filter
The headless browser for AI agents and web scraping
A machine learning library with a TypeScript API and Rust backend. CUDA and WebGPU compatibility. Built to understand how ML frameworks and models work internally.
rvLLM: High-performance LLM inference in Rust. Drop-in vLLM replacement.
A high-performance and light-weight router for vLLM large scale deployment
A lightweight, efficient transformer inference engine written in Rust. MiniLLM provides a clean, well-documented implementation of GPT-2 style transformer models with support for text generation.