OCIP is an open protocol for decentralized private AI inference. It defines how consumers submit inference requests and how providers serve them, with configurable privacy guarantees ranging from no isolation (reputation-only) to hardware-encrypted confidential compute.
OCIP is platform-agnostic — it works on Apple Silicon, AMD, Intel, ARM, and NVIDIA hardware. It's designed so anyone can implement a provider, coordinator, or client without vendor lock-in or patent encumbrance.
Centralized inference providers (OpenAI, Anthropic, Google) see every prompt in plaintext. Decentralized alternatives either offer no privacy (Bittensor, io.net) or lock into a single platform with proprietary protocols. OCIP provides:
- An open standard — anyone can implement it, no license required
- Configurable privacy — from "trust the provider" to "hardware-encrypted memory"
- Multi-platform — not locked to macOS, Apple Silicon, or any vendor's attestation scheme
- Practical from day one — the lowest tier works with zero special hardware
- Honest about guarantees. Each isolation tier clearly states what it defends against and what it doesn't. No security theater.
- Lowest tier is zero-friction. A provider can start serving in minutes with no special hardware, enrollment, or certificates. Security upgrades are progressive.
- Protocol, not product. OCIP defines the wire format and semantics. Billing, routing algorithms, and UIs are implementation choices, not protocol concerns.
- Platform backends, not platform lock-in. Attestation and isolation are abstract interfaces. Each platform (macOS, Linux, Windows) provides its own backend.
| Document | Contents |
|---|---|
| 01 — Overview | Goals, scope, terminology |
| 02 — Confidence Levels | The 5 isolation tiers and what each guarantees |
| 03 — Trust Anchors | Hardware roots of trust per platform |
| 04 — Attestation | How providers prove their security posture |
| 05 — Confidential Transport | Per-request encryption and key exchange |
| 06 — Wire Format | Message types, encoding, and transport |
| 07 — Coordination | Provider registration, routing, lifecycle |
Inference Exchange is the reference implementation of OCIP — a working marketplace with coordinator, provider agents, matching engine, E2E encryption, and web dashboards.
Working draft. The core wire format (§06) and coordination protocol (§07) are implemented and running. Confidential transport (§05) is implemented with X25519/NaCl. Trust anchors (§03) and full attestation (§04) are specified but not yet enforced in the reference implementation.
Apache 2.0 — use it, implement it, extend it, build products on it.