Skip to content
qzyu999Public

About

Open Confidential Inference Protocol

Resources

Stars

4 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

OCIP — Open Confidential Inference Protocol

OCIP is an open protocol for decentralized private AI inference. It defines how consumers submit inference requests and how providers serve them, with configurable privacy guarantees ranging from no isolation (reputation-only) to hardware-encrypted confidential compute.

OCIP is platform-agnostic — it works on Apple Silicon, AMD, Intel, ARM, and NVIDIA hardware. It's designed so anyone can implement a provider, coordinator, or client without vendor lock-in or patent encumbrance.

Why OCIP Exists

Centralized inference providers (OpenAI, Anthropic, Google) see every prompt in plaintext. Decentralized alternatives either offer no privacy (Bittensor, io.net) or lock into a single platform with proprietary protocols. OCIP provides:

  • An open standard — anyone can implement it, no license required
  • Configurable privacy — from "trust the provider" to "hardware-encrypted memory"
  • Multi-platform — not locked to macOS, Apple Silicon, or any vendor's attestation scheme
  • Practical from day one — the lowest tier works with zero special hardware

Design Principles

  1. Honest about guarantees. Each isolation tier clearly states what it defends against and what it doesn't. No security theater.
  2. Lowest tier is zero-friction. A provider can start serving in minutes with no special hardware, enrollment, or certificates. Security upgrades are progressive.
  3. Protocol, not product. OCIP defines the wire format and semantics. Billing, routing algorithms, and UIs are implementation choices, not protocol concerns.
  4. Platform backends, not platform lock-in. Attestation and isolation are abstract interfaces. Each platform (macOS, Linux, Windows) provides its own backend.

Specification

Document Contents
01 — Overview Goals, scope, terminology
02 — Confidence Levels The 5 isolation tiers and what each guarantees
03 — Trust Anchors Hardware roots of trust per platform
04 — Attestation How providers prove their security posture
05 — Confidential Transport Per-request encryption and key exchange
06 — Wire Format Message types, encoding, and transport
07 — Coordination Provider registration, routing, lifecycle

Reference Implementation

Inference Exchange is the reference implementation of OCIP — a working marketplace with coordinator, provider agents, matching engine, E2E encryption, and web dashboards.

Status

Working draft. The core wire format (§06) and coordination protocol (§07) are implemented and running. Confidential transport (§05) is implemented with X25519/NaCl. Trust anchors (§03) and full attestation (§04) are specified but not yet enforced in the reference implementation.

License

Apache 2.0 — use it, implement it, extend it, build products on it.

About

Open Confidential Inference Protocol

Resources

Stars

4 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors