• Publishing Kafka clusters over HTTP (in this case, HTTP/2 and gRPC)
• Synchronizing Kafka clusters across different data centers
• Simpler than Kafka REST API, thanks to bidirectional HTTP/2 streaming
• One connection = one Kafka client – disconnection gracefully and immediately terminates the Kafka client.
• Support multiple connections to a single topic with rebalancing
• Consistent repartition a topic on the fly using different methods
• Message filtering and mangling using Lua script

A gRPC server that streams messages from requested topics in configured Kafka clusters. Supports multiple connections to the same topic within a single consumer group, with proper rebalancing handling.

A gRPC client that connects to the server and writes the message stream to configured Kafka clusters.

A public Go client library for connecting to Karp Server.

Usage example

Protocol definition for other languages.

• karpserver
• karpclient