Model executor runtime 💬 written in Rust

A Lazy, high throughput and blazing fast structured text generation backend.

A reactive runtime for building durable AI agents

A reactive runtime for building durable AI agents

AICI: Prompts as (Wasm) Programs

Burgonet Gateway is an enterprise LLM gateway that provides secure access and compliance controls for AI systems

Burgonet Gateway is an enterprise LLM gateway that provides secure access and compliance controls for AI systems

Prompt-centric framework for developing LLM applications in Rust

🧠 Motorhead is a memory and information retrieval server for LLMs.

Robot VLM and VLA (Vision-Language-Action) inference API helping you manage multimodal prompts, RAG, and location metadata

🧬 The adaptive model routing system for exploration and exploitation.

Turn single LLM calls into fast micro-batches. Rust core, Python API.

Local-First Autonomous Development Infrastructure

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

Govern & Secure your AI

Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

A QA playbook system for running through scenario testing

A Cookbook of recipes from batuta

Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

A lightweight, secure executor for Claude Agent Skills. Inspired by OpenClaw but strictly designed with zero-trust whitelisting, written in Rust.