Skip to content
@hanzoai

Hanzo AI

AI infrastructure for the agentic era — LLM gateway, MCP tools, multi-agent SDKs, and dev tools. Techstars '17.

Hanzo

Open-source AI infrastructure. The parts below run on your own machine with no account; the hosted cloud at api.hanzo.ai adds sign-in, billing and hosted models.

hanzo.ai · docs.hanzo.ai · hanzoskills.com

Run it on your own machine

Repository What it is Start it
base SQLite application backend, one Go binary in a clone: go run ./examples/base serve, then http://127.0.0.1:8090/v1/
cloud the open-source cloud, one Go binary with the console built in in a clone: make build && CLOUD_DEV_UNENCRYPTED=1 CLOUD_LISTEN=127.0.0.1:8080 CLOUD_DATA_DIR=.dev/data ./cloud, then http://127.0.0.1:8080
zip Go framework: an operation declared once is served as REST, OpenAPI and an MCP tool in a clone: go run ./examples/hello, then http://localhost:8080/hello
mcp MCP server for coding agents npx -y --package=@hanzo/mcp hanzo-mcp serve (stdio)
engine model inference, in Rust cargo install --git https://github.com/hanzoai/engine --locked hanzo-cli, then hanzo-engine serve -m <model-id>, on http://localhost:1234/v1

The cloud command runs unencrypted, for local development only: its make dev cannot encrypt a store yet.

Use the hosted cloud

curl -fsSL https://hanzo.sh | sh    # hanzo, hanzo-mcp and dev, into ~/.local/bin
hanzo auth login                    # sign in with Hanzo IAM

The API is https://api.hanzo.ai/v1/, and every operation is documented at docs.hanzo.ai.

For coding agents

curl hanzoskills.com/skill.md    # what runs locally, what needs an account, how to work either way
curl hanzoskills.com/llms.txt    # every skill and specification

Where things live

Repository What it is
cli hanzo: a coding agent, and every hosted product from the terminal
iam identity: the sign-in every Hanzo service uses
kms secrets
gateway the edge of api.hanzo.ai: identity, rate limits, metering
ui · gui · design React components, the cross-platform UI framework, design tokens
python-sdk · js-sdk · sdk SDKs
dev a coding agent for the terminal
hips design specifications

All repositories

Hanzo AI, Inc. — Techstars '17

Popular repositories Loading

  1. ai ai Public

    Hanzo AI — LLM control plane, RAG, and model hub. Native Go routing for 66+ models over an OpenAI-compatible /v1 API; mounts as the 'ai' subsystem inside hanzoai/cloud.

    Go 3

  2. ml ml Public

    Hanzo ML — fast multi-backend (CPU/CUDA/Metal/ROCm/Vulkan) tensor & ML framework for Rust with quantization; the compute core of the Hanzo stack.

    Rust 2

  3. ingress ingress Public

    Hanzo Ingress -- cloud-native, Kubernetes-native L7 reverse proxy and load balancer for Hanzo AI infrastructure (automatic TLS, dynamic config, zero-downtime reloads).

    Go 2

  4. cuckoo cuckoo Public

    🐦 Event recording library.

    CoffeeScript 1

  5. form.js form.js Public

    🖍️ Automagic forms.

    CoffeeScript 1

  6. gochimp3 gochimp3 Public

    🐒 Golang client for MailChimp API 3.0.

    Go 1

Repositories

Showing 10 of 340 repositories

Top languages

Loading…

Most used topics

Loading…