Make Your Mixture-of-Models Programmable.

Documentation | Playground | Blog | Publications | Hugging Face | Slack

vLLM Semantic Router is a programmable routing layer for building Mixture-of-Models systems across heterogeneous LLM infrastructure. It evaluates request signals, user preferences, and application policies to select—or compose—the right model path for each request.

Use it to improve quality, cost, latency, privacy, and safety without hard-coding routing logic into applications.

Explore how it works →

curl -fsSL https://vllm-sr.ai/install.sh | bash -s -- --channel stable

For pip, uv, or agent-driven installation, see the Installation Guide.

Try the online playground at https://app.vllm-sr.ai/playground.

Credentials:

• Username: love@vllm-sr.ai
• Password: vllm-sr-read

• [2026/07/21] New Blog: Beyond a Single Model: Building Mixture-of-Models Systems with vLLM Semantic Router
• [2026/06/29] New Blog: Micro-Agent: Beat Frontier Models with Collaboration inside Model API
• [2026/06/16] New Blog: Beyond One Model: Fusion in vLLM Semantic Router
• [2026/06/05] v0.3 Released: vLLM Semantic Router v0.3 Themis: From Signals to Stateful Production Routing

More announcements are available on the Blog and Publications pages.

For questions, feedback, or to contribute, please join the #semantic-router channel in vLLM Slack. Track contributors, workgroups, and weekly activity at community.vllm-sr.ai.

We host two monthly community meetings across APAC and the Americas:

• APAC-friendly meeting — second Wednesday of the month: 9:00-10:00 AM Singapore time (UTC+8; the same local time in Beijing)
  • Google Meet
  • Google Calendar Invite
• Americas-friendly meeting — fourth Wednesday of the month: 8:00-9:00 PM Eastern Time (America/New_York) / 5:00-6:00 PM Pacific Time
  • Google Meet
  • Google Calendar Invite

If you want to contribute, start with CONTRIBUTING.md.

For repository-native development workflow and validation commands, use AGENTS.md as the entrypoint and tools/agent/docs/README.md as the canonical index.

If you find Semantic Router helpful in your research or projects, please consider citing it:

@misc{semanticrouter2025,
  title={vLLM Semantic Router},
  author={vLLM Semantic Router Team},
  year={2025},
  howpublished={\url{https://github.com/vllm-project/semantic-router}},
}

We are grateful to our sponsors who support us:

AMD provides us with GPU resources and ROCm™ software for training and researching frontier router models, enhancing E2E testing, and building the online models playground.