33rd of 41 in Gateways and observability
MLflow
Tracing, evals, prompt registry and AI gateway plus classic ML tracking
- Stars
- 28.5k
- License
- Apache-2.0
- Last commit
- Oct 2026
- Last release
- Oct 2026
- Language
- Python
24,741 on 27 Mar 202628,513 on 23 Oct 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
Single mlflow server (port 5000) that records OpenTelemetry traces from 60+ frameworks via one-line autolog, runs evaluations with 50+ metrics and LLM judges, versions and optimizes prompts, and fronts providers through an OpenAI-compatible AI Gateway with rate limits, fallbacks and traffic splitting. Keeps the original experiment tracking, model registry and deployment tooling. For teams wanting one platform for GenAI and ML.
Who it is for: Teams wanting one platform for GenAI tracing and ML tracking
Ranked among open-source alternatives to LangSmith (#1 of 10).
Strengths
- One-line autolog for 60+ frameworks in Python, TypeScript and Java; MCP and OTel native
- Starts with uvx mlflow server; no separate database needed to begin
- AI Gateway adds credential management, guardrails and A/B traffic splitting
- Setup wizard lets Claude Code, Codex or OpenCode add tracing to a project
Weaknesses
- README covers the quickstart; production backend store and auth setup live in docs
- Broad scope (ML tracking plus GenAI) means a large install and UI surface
- No Dockerfile or compose file at the repo root
- TypeScript and Java coverage is smaller than Python (5 TS and 2 Java frameworks listed)
What it needs
- no GPU
- Docker + Compose
- Models: any LLM provider via autolog or the AI Gateway
- port 5000
Quick answers
Is MLflow open source?
Yes. Its code is on GitHub under the Apache-2.0 license.
Can you run MLflow with Docker?
Yes. Its repository has a Docker setup: a Dockerfile, a Compose file or a published image.
Does MLflow need a GPU?
No, it runs without one.
Head to head
Also in Gateways and observability
See all 41| Rank | Project | Score |
|---|---|---|
| 1 | OmniRouteLLM gateway routing one OpenAI-compatible endpoint across 372 providers | 96 out of 100 |
| 2 | new-apiGateway that unifies LLM providers behind OpenAI, Anthropic and Gemini APIs | 90 out of 100 |
| #4 | LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers | 86 out of 100 |
| #5 | freellmapiOpenAI-compatible gateway pooling free-tier LLM providers with automatic failover | 86 out of 100 |
| #6 | LangfuseTracing, prompt management and evals for LLM apps on ClickHouse | 85 out of 100 |