Go High-Performance Service Registry

A lightweight, high-concurrency Service Registry and Discovery server built with Go and gRPC. The system uses a sharded in-memory architecture to minimize lock contention and achieve high throughput under mixed read/write workloads.

• High-Performance Storage

  • Implements a sharded map (32 shards) to significantly reduce sync.RWMutex contention
  • Designed as an alternative to a single global lock or standard Go map

• gRPC & Protobuf

  • Efficient binary serialization for low-latency, high-throughput communication

• Service Governance

  • Server-side TTL (Time-To-Live) enforcement
  • Active heartbeat monitoring to automatically evict stale services

• Thread-Safe by Design

  • Fully concurrency-safe
  • Optimized for read-heavy and mixed read/write access patterns

The core engine uses a sharding strategy (conceptually similar to Java’s ConcurrentHashMap) to partition storage into multiple independent buckets based on the FNV-1a hash of the service name.

Each shard owns its own lock, allowing concurrent operations to proceed without contending on a global mutex.

graph TB
  Client -->|Register / Discover| GRPC[gRPC Server]
  GRPC -->|hash service name| Selector[Shard Selector]

  Selector -->|idx = 0| Shard0[Shard 0 - RWMutex]
  Selector -->|idx = 1| Shard1[Shard 1 - RWMutex]
  Selector -->|...| ShardN[Shard N - RWMutex]
  Selector -->|idx = 31| Shard31[Shard 31 - RWMutex]

Benchmarks were run on an Apple M1 (8-core) machine using Go 1.2x. The in-memory storage engine sustains over 5.3 million operations per second with low memory allocation overhead.

• OS: macOS (Darwin/arm64)
• CPU: Apple M1
• Command:

cd pkg/storage/
go test -bench=. -benchmem -run=^$ .

BenchmarkRegister-8    6118419    187.3 ns/op    192 B/op    4 allocs/op
BenchmarkDiscover-8    5664952    208.8 ns/op    512 B/op    6 allocs/op

• Go 1.21+
• protoc (Protocol Buffers Compiler)

The server listens on :50055 with a default TTL of 15 seconds.

go run server/*.go

In a separate terminal, start a demo client:

go run client/main.go -name=order-service -port=8080

.
├── proto/           # gRPC service definitions (Protobuf)
├── pkg/
│   └── storage/     # Core sharded in-memory engine
├── server/          # gRPC server implementation
└── client/          # Demo client

• Consistent hashing for multi-node cluster mode
• Watch API using gRPC streaming for real-time service updates
• Persistent storage (Write-Ahead Log) for crash recovery