TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

⚙️🦀 Build modular and scalable LLM Applications in Rust

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

AICI: Prompts as (Wasm) Programs

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

A reactive runtime for building durable AI agents

🧠 Motorhead is a memory and information retrieval server for LLMs.

Fast, streaming indexing, query, and agentic LLM applications in Rust

Govern & Secure your AI

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

Open-source virtual model gateway: publish multi-model workflows as OpenAI/Claude-compatible endpoints with trace, token, latency, and cost visibility.

AURA is an agentic harness that turns an LLM model into a reliable, autonomous service capable of executing real SRE work. AURA provides the guardrails, API servers, state management, authentication, streaming, error handling, and tool integrations necessary to run AI SRE agents safely in production.

An open source, Native AI Gateway and LLM proxy built in Rust

Zero-code LLM security & observability proxy. Real-time prompt injection detection, PII scanning, and cost control for OpenAI-compatible APIs. Built in Rust.

Simple, Composable, High-Performance, Safe and Web3 Friendly AI Agents and LazAI Gateway for Everyone

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude, Codex, DeepAgents and more — deployed on the provider side, no SDK changes required.

🧬 The adaptive model routing system for exploration and exploitation.

The open-source safety layer for AI agents — block unsafe tool calls, require approval, enforce budgets, audit, replay.