🦍 The Cloud-Native API Gateway and AI Gateway.

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

🤖 AI Gateway | AI Native API Gateway

A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

LLMs and Machine Learning done easily

🦄APIPark is the #1 open-source AI Gateway and Developer Portal, enabling you to easily manage, integrate, and deploy AI and API services. APIPark seamlessly connects with various large AI models and packages these AI capabilities into APIs for easy invocation.

Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.

Build reliable, secure, and production-ready AI apps easily.

Build reliable, secure, and production-ready AI apps easily.

Inference Hub for AI at Scale

Kubernetes Configs for Portkey Gateway deployment

Azure OpenAI + Cloudflare AI Gateway 进行翻译或润色

Tests and Bicep related to API Management AI Gateway testing.

OpenAPI specification for the Portkey API

Gateway to control LLM API/SDK calls. Supports access to OpenAI, Azure, Anthropic and Bedrock calls

ai assistant web app using openai assistant api + cloudflare services

Set of Otoroshi plugins to interact with LLMs

Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.