Provide visibility, traceability, and cost tracking for AI requests with minimal overhead across multiple AI providers and APIs.

A high-performance reverse proxy that intelligently distributes requests across multiple LLM providers (OpenAI, Google Gemini, Anthropic Claude) and API keys. It provides seamless OpenAI API compatibility, advanced load balancing algorithms, real-time cost optimization, and enterprise-grade observability.

🚀 Build with the Langfuse Go SDK to enhance your applications using Langfuse's open-source LLM engineering platform.

When AI makes $10M decisions, hallucinations aren't bugs—they're business risks. We built the verification infrastructure that makes AI agents accountable without slowing them down.

🚀 An intelligent, production-ready LLM orchestration platform in Go, engineered for high availability with dynamic real-time routing and seamless failover. Optimizes for cost, latency, and quality across any model from any provider, with a modular design and built-in support for OpenAI, Anthropic, Google, and Mistral.

The Control Plane for your LLM API Keys. Manage 30+ providers with one CLI.

XScopeHub — Observability Suite : Bridges exporters, OpenTelemetry, and OpenObserve with ETL pipelines for metrics, logs, and traces.

A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics

A proxy-based tool for tracing, recording, and replaying LLM API requests.

Enterprise AI governance reference implementation with gateway controls, telemetry, detections, and rollout validation.

The reliability layer between your code and LLM providers. Hapax is a production-ready AI infrastructure layer that ensures uninterrupted AI operations through intelligent provider management and automatic failover. It is designed to address common challenges in managing AI infrastructure

Honey Hive Go SDK

The reliability layer between your code and LLM providers.

SDK to integrate Maxim in your Go app.

🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.

One API for 25+ LLMs, OpenAI, Anthropic, Bedrock, Azure. Caching, guardrails & cost controls. Go-native LiteLLM & Kong AI Gateway alternative.

Finetune LLMs on K8s by using Runbooks

专注在智能运维、自动化运维、Zabbix、Prometheus、Grafana、Nagios、ELK Stack（Elasticsearch、Logstash、Kibana）、Graylog、Ansible、SaltStack、Puppet、Chef、Terraform、Docker、Kubernetes、OpenShift、Jenkins、MySQL、PostgreSQL、MariaDB、Redis、MongoDB、InfluxDB、Ceph、MinIO，RabbitMQ、Kafka、NATS、Apache Pulsar、Nginx、Apache HTTP Server、HAProxy、Traefik、Caddy、OpenStack、OpenLDAP、FreeRDP等多个领域。