TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

⚙️🦀 Build modular and scalable LLM Applications in Rust

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

🧠 Motorhead is a memory and information retrieval server for LLMs.

AICI: Prompts as (Wasm) Programs

Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

Fast, streaming indexing, query, and agentic LLM applications in Rust

A reactive runtime for building durable AI agents

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

Simple, Composable, High-Performance, Safe and Web3 Friendly AI Agents and LazAI Gateway for Everyone

Govern & Secure your AI

🧬 The adaptive model routing system for exploration and exploitation.

A production-ready framework for composing AI agents from declarative TOML configuration, with MCP tool integration, RAG pipelines, and an OpenAI-compatible web API.

Code intelligence for humans, machines, and LLMs: receipts, metrics, and insights from your codebase.

Zero-code LLM security & observability proxy. Real-time prompt injection detection, PII scanning, and cost control for OpenAI-compatible APIs. Built in Rust.

Robot VLM and VLA (Vision-Language-Action) inference API helping you manage multimodal prompts, RAG, and location metadata

Prompt-centric framework for developing LLM applications in Rust

Burgonet Gateway is an enterprise LLM gateway that provides secure access and compliance controls for AI systems