Distributed, multi-tenant key-value and object store in Rust, with Raft consensus, WAL durability, and production-oriented operations.

v1.0.0 is the GA line focused on data/ML workflows and operational reliability.

• Time-series API handlers are production-backed (/ts/write, /ts/query).
• Vector search endpoints are available and persisted on coordinator disk.
• Python SDK preview supports notebook workflows (pandas/polars/pyarrow helpers).
• Observability bundle now includes Grafana dashboard provisioning and Prometheus alerts.
• Helm chart is available with dev/staging/prod values profiles.
• Release engineering includes preflight checks and runbooks.

• What is minikv
• Quick Start
• Python SDK
• Core Features
• Operations and Release Engineering
• Roadmap
• Development
• Contributing

minikv is a distributed systems reference implementation and an extensible data platform.

• Strong consistency: Raft for metadata and 2PC patterns for distributed writes.
• Durability: WAL and pluggable storage backends.
• Multi-tenancy and security: RBAC, API keys/JWT, encryption at rest.
• Real-time and analytics pathways: watch/SSE and time-series APIs.

Build and run local cluster:

git clone https://github.com/whispem/minikv.git
cd minikv
make build
make serve

Basic checks:

curl -s http://127.0.0.1:5000/health/live
curl -s http://127.0.0.1:5000/health/ready
curl -s http://127.0.0.1:5000/metrics
curl -s http://127.0.0.1:5000/admin/status

Notebook-first SDK (preview) for data scientists and engineers:

• Time-series write/query helpers
• Vector upsert/query helpers
• SSE change-stream consumption
• Dataframe conversions (pandas, polars, pyarrow)

Install and run example:

pip install -r sdk/python/requirements.txt
python examples/data_science_quickstart.py

Files:

• sdk/python/minikv_client.py
• sdk/python/README.md
• examples/data_science_quickstart.py

Distribution and consistency:

• Raft consensus (leader election, log replication)
• 256 virtual shards and placement management
• Multi-key operations and transaction endpoints
• Cross-DC replication primitives and conflict policies

Storage and query paths:

• Pluggable backends: RocksDB, Sled, in-memory
• WAL, compaction, and integrity tooling
• Time-series engine with aggregation and downsampling
• Vector similarity endpoints with cosine top-k search

Security and tenancy:

• API keys (Argon2), JWT, RBAC
• AES-256-GCM encryption at rest
• Tenant quotas and request rate limiting
• Audit logging

APIs:

• HTTP REST and S3-compatible endpoints
• WebSocket/SSE watch endpoints
• gRPC internal communication

Observability:

• Prometheus and OpenTelemetry integration
• Grafana dashboard provisioning
• Alert rules in opentelemetry/prometheus-alerts.yml

Kubernetes:

• Operator manifests under k8s/
• Helm chart under k8s/helm/minikv/

Runbooks:

• Backup/restore: docs/ops-backup-restore.md
• Release process: docs/release-engineering-v1.0.0.md

Preflight commands:

make release-preflight
make release-preflight-full

v1.1.0:

• Kafka Connect sink/source templates for CDC
• Read replicas for analytical traffic
• Vector index acceleration (HNSW/PQ)
• Better analytics query ergonomics

v1.2.0:

• Distributed transactions scope expansion
• Multi-region active-passive with explicit failover
• Point-in-time recovery (PITR)
• Policy-driven data lifecycle automation

Future:

• Multi-region active-active
• WebAssembly UDF sandbox
• Global secondary indexes
• Expanded SQL layer

make build
make test
make fmt
make clippy
make verify

Project layout:

src/
  bin/          # minikv, minikv-coord, minikv-volume
  common/       # auth, backup, cdc, metrics, replication, timeseries, ...
  coordinator/  # coordinator server and HTTP/gRPC APIs
  volume/       # volume node storage and APIs
  ops/          # integrity, compact, repair tooling
k8s/            # operator manifests and Helm chart
opentelemetry/  # Prometheus/Grafana/Jaeger stack
sdk/python/     # notebook-first Python client preview
docs/           # runbooks and release engineering docs

Contributions are welcome. See CONTRIBUTING.md for coding, testing, and PR workflow.

MIT. See LICENSE.