Stars
Empowering everyone to build reliable and efficient software.
An extremely fast Python package and project manager, written in Rust.
Lightweight coding agent that runs in your terminal
an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM
Build and publish crates with pyo3, cffi and uniffi bindings as well as rust binaries as python packages
A blazing fast inference solution for text embeddings models
Renderer for the harmony response format to be used with gpt-oss
The official Rust SDK for the Model Context Protocol
Instant, controllable, local pre-trained AI models in Rust
Fast ML inference & training for ONNX models in Rust
Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙
Hibiki is a model for streaming speech translation (also known as simultaneous translation). Unlike offline translation—where one waits for the end of the source utterance to start translating--- H…
🦀⚙️ Sudoless performance monitoring for Apple Silicon processors. CPU / GPU / RAM usage, power consumption & temperature 🌡️
LSP server leveraging LLMs for code completion (and more?)
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
[SIGMOD 2026] F3: The Open-Source Data File Format for the Future