#kafka


  1. rdkafka

    Rust wrapper for librdkafka

    v0.39.0 2.1M #kafka #topic-partition

  2. schema_registry_converter

    Encode/decode data from/to kafka using the Confluent Schema Registry

    v4.10.0 163K #json-schema #kafka #protobuf #avro

  3. rskafka

    A minimal Rust client for Apache Kafka

    v0.6.0 113K #kafka #protocols #async

  4. kafka-protocol

    Kafka wire protocol

    v0.17.0 15K #kafka

  5. rumqttd

    high performance MQTT broker written in Rust which is light weight and embeddable

    v0.20.0 30K #broker #mqtt-broker #iot #nats #kafka #mqtt

  6. sea-streamer

    🌊 The stream processing toolkit for Rust

    v1.0.0-rc.1 7.7K #async-stream #stream-processing #kafka

  7. aws-sdk-kafka

    AWS SDK for Managed Streaming for Kafka

    v1.117.0 6.0K #kafka #aws-sdk #msk #cluster #managed-streaming

  8. kcr_kafka_strimzi_io

    Kubernetes Custom Resource Bindings

    v3.20260604.80828 42K #kafka #kubernetes-custom-resource-bindings #kafka-topic

  9. kfk

    A pure Rust Kafka CLI tool for cluster management, topic operations, and message produce/consume

    v0.1.6 #kafka-topic #kafka #kafka-admin #kafka-client

  10. mq-bridge

    An asynchronous message bridging library connecting Kafka, MQTT, AMQP, NATS, MongoDB, HTTP, and more

    v0.3.2 700 #amqp #cqrs #kafka #nats

  11. hyperi-rustlib

    There's plenty of sage advice out there about how to run Rust services in production at scale — config cascades, structured logging, masking secrets, multi-backend secrets management…

    v2.8.15 #prometheus #kafka #kubernetes #open-telemetry #observability

  12. tansu-sans-io

    A Kafka protocol implementation using serde

    v0.6.0 220 #kafka #quote #syn #serde

  13. samsa

    Rust-native Kafka/Redpanda protocol and client implementation

    v0.1.8 290 #kafka #redpanda #confluent

  14. kafka

    Rust client for Apache Kafka

    v0.10.0 31K #kafka-topic #queue

  15. scalo

    Self-regulating runtime for data-plane services -- config, logging, metrics, health, transport, backpressure, adaptive scaling. Batteries included; idiomatic Rust (also on PyPI).

    v2.10.1 #observability #auto-scaling #kafka #data-plane #backpressure

  16. aws-sdk-kafkaconnect

    AWS SDK for Managed Streaming for Kafka Connect

    v1.106.0 500 #kafka #aws-sdk #streaming-for-kafka #connect #managed

  17. yozefu

    CLI tool for Apache kafka. It allows you to navigate topics and search Kafka records.

    v0.0.30 #kafka #ratatui #avro #kafka-consumer

  18. kafka_client

    A pure Rust Kafka client library with SASL authentication support

    v0.5.2 #kafka #tls #sasl #async

  19. rastreo

    CLI for rastreo — enrichment-aware network discovery

    v0.6.0 #kafka #discovery #snmp #observability

  20. tansu-model

    Kafka JSON protocol definitions, bootstrapping Tansu sans I/O

    v0.6.0 230 #amazon-s3 #kafka #delta-lake #postgresql

  21. krb5-gss

    Pure Rust Kerberos protocol engine and krb5 GSS-API mechanism (initiator), no FFI

    v0.1.0 #kerberos #krb5 #sasl #kafka #gssapi

  22. pilgrimage

    A Kafka-like message broker in Rust

    v0.16.4 1.6K #message-broker #metrics-monitoring #kafka #rust

  23. tansu

    Apache Kafka compatible broker with S3, PostgreSQL, Apache Iceberg and Delta Lake

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  24. mq-bridge-app

    A message queue bridge application written in Rust, designed to connect different messaging systems like RabbitMQ, Kafka, and NATS

    v0.2.5 #amqp #kafka #nats #cqrs

  25. kafka-client-protocol

    Kafka protocol message types generated from Kafka specification

    v0.2.0 #kafka #topic #broker #sasl-authentication #generated

  26. schemreg

    Async Confluent + AWS Glue schema registry client — wire format, traits, caching, HTTP

    v0.3.0 750 #schema-registry #confluent #kafka #avro #glue

  27. kafkit-client

    Kafka 4.0+ pure Rust client

    v0.1.9 #kafka #client #producer-consumer #kafka-consumer

  28. rustfs-kafka

    Rust client for Apache Kafka

    v1.2.0 6.0K #kafka #queue

  29. crabka-security

    TLS, SASL, SCRAM, OAuth, and Kerberos security utilities for Crabka

    v0.3.9 450 #tls #crabka #kafka #sasl #scram

  30. ksunami

    Produce constant, configurable, cyclical waves of Kafka Records

    v0.1.10 650 #kafka #performance-testing #development-tools #workload

  31. faucet-source-kafka

    Apache Kafka consumer source for the faucet-stream ecosystem

    v1.3.0 #kafka #etl-pipeline #connector #streaming #pipeline #etl

  32. sentry_arroyo

    working with streaming data

    v2.41.0 8.3K #kafka #stream-processing #arroyo #message-processing #strategies #librdkafka #rebalancing

  33. nisshi

    Apache Kafka compatible broker with S3, PostgreSQL, Apache Iceberg and Delta Lake

    v0.6.0 #amazon-s3 #kafka #postgresql

  34. aws-msk-iam-sasl-signer

    AWS MSK IAM SASL Signer

    v1.0.1 182K #kafka #iam #sasl #msk #aws

  35. klag-exporter

    High-performance Kafka consumer group lag exporter with offset and time lag metrics

    v0.1.24 #prometheus #metrics #kafka #lag #prometheus-exporter

  36. rdkafka-sys

    Native bindings to the librdkafka library

    v4.10.0+2.12.1 1.6M #kafka #librdkafka

  37. tansu-storage

    Storage abstraction for PostgreSQL, libSQL and ObjectStore (S3 or memory)

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  38. tansu-schema

    Avro, JSON and Protocol buffer validation with conversion to Apache Iceberg, Delta Lake or Parquet via Apache Arrow

    v0.6.0 100 #amazon-s3 #kafka #delta-lake #postgresql

  39. osproxy-sink

    Write sink: Sink trait + OpenSearchSink now; QueueSink (Kafka) redundancy later behind the same trait

    v1.0.1 #cluster #documentation #traits #redundancy #sink-write #opensearch #grpc #kafka #epoch #fips

  40. crabka-protocol

    Apache Kafka wire-protocol codec (4.3.0), with typed RecordBatch and zero-copy borrowed decode

    v0.3.9 450 #serialization #kafka #decoder

  41. crabka-audit

    Audit event model, OCSF serialization, and write pipeline for Crabka (FedRAMP 20x MLA)

    v0.3.8 #kafka #crabka #audit #ocsf #fedramp

  42. crabka-schema-serde

    Confluent-compatible schema serdes (Avro/Protobuf/JSON) for Crabka clients

    v0.3.9 290 #protobuf #crabka #avro-schema #kafka #avro

  43. streamling-state

    State management and persistence for Streamling

    v0.2.0 #data-fusion #streamling #postgresql #state #sqlite #wasm #data-streaming #kafka #in-memory #key-table

  44. rustfs-kafka-async

    Async Kafka client built on tokio

    v1.2.0 5.3K #kafka #tokio #queue #async

  45. kafrust

    A pure Rust Kafka client with no librdkafka or C toolchain dependency

    v0.2.1 #kafka #client #protocols

  46. tradingview-rs

    Tradingview datafeed api tradingview-rs project

    v0.2.0 #algorithmic-trading #data-source #symbol-search #websocket-client #market #authentication #session-cookies #kafka #rate-limiting #user-name

  47. mockforge-kafka

    Kafka protocol support for MockForge

    v0.3.198 #kafka #testing #event-streaming #mocking

  48. crabka-log

    Byte-compatible reader/writer for Apache Kafka's on-disk log format

    v0.3.8 260 #kafka #crabka #record #log-storage #storage

  49. kafkalite-server

    Broker-owned file-log Kafka wire protocol server

    v1.1.5 #broker #server #kafka #streaming

  50. crabka-replicator

    Cross-cluster geo-replication service for Crabka (MirrorMaker-2 equivalent)

    v0.3.8 #kafka #crabka #replication #mirrormaker

  51. tansu-service

    Tansu protocol services and layers

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  52. prosody

    Event sourcing library with persistent timers that isolates per-key failures

    v0.4.0 #kafka #open-telemetry #distributed-systems #tracing

  53. proto-kafka

    Kafka wire protocol

    v0.19.3 #kafka

  54. crabka-schema-registry

    Confluent Schema Registry-compatible REST service for Crabka (binary: crabka-schema-registry)

    v0.3.8 210 #schema-registry #crabka #avro-schema #kafka #avro

  55. kacrab

    A Kafka client for Rust, built from the protocol up

    v0.3.0 #kafka #protocols #client

  56. krafka

    A pure Rust, async-native Apache Kafka client

    v0.12.0 110 #kafka

  57. kafko

    In-process log with Kafka-like semantics: topics, partitions, offset-based reads, replay, retention

    v0.3.0 #kafka #wal #event-sourcing #embedded

  58. crabka-client-core

    Connection management and request dispatch for Apache Kafka in Rust

    v0.3.8 370 #kafka #crabka #protocols #client

  59. crabka-rebalancer

    Cruise-Control-equivalent partition rebalancer for Crabka clusters

    v0.3.8 110 #crabka #kafka #rebalancer

  60. crabka-client-admin

    Operator-side admin client for Crabka clusters

    v0.3.8 280 #crabka #admin-client #kafka #client #admin

  61. kafka_wire_protocol

    Generated implementation of Apache Kafka wire protocol

    v3.0.0 #kafka #protocols

  62. queuepeek

    A TUI multi-broker message queue inspector for RabbitMQ, Kafka, and MQTT

    v0.10.4 #kafka #rabbitmq #tui #mqtt

  63. crabka-throttle

    Shared token-bucket throttling primitives for Crabka

    v0.3.8 #kafka #crabka #throttling

  64. crabka-operator

    Kubernetes operator for Crabka clusters

    v0.3.8 110 #crabka #operator #kubernetes-operator #kafka #kubernetes

  65. crabka-broker

    Single-node Apache Kafka-compatible broker (MVP)

    v0.3.8 190 #kafka #broker #crabka #streaming

  66. crabka-records-legacy

    Kafka v0/v1 MessageSet (legacy) codec and v2 RecordBatch bridge

    v0.3.8 200 #kafka #wire-protocol #down-conversion #messageset

  67. crabka-connect

    Connector-framework SPI (Source/Sink + converters) for Crabka

    v0.3.8 #kafka #connector #crabka #cdc

  68. picokafka

    Kafka library for tarantool-module based on librdkafka

    v0.3.0 230 #kafka #tarantool #librdkafka #builder #tokio #tx #communication-channel

  69. crabka-remote-storage-topic

    Topic-backed RemoteLogMetadataManager for Crabka tiered storage

    v0.3.8 240 #crabka #kafka #tiered-storage #metadata

  70. crabka-authz

    Shared Kafka-ACL authorization evaluator for the Crabka broker and gateway

    v0.3.8 230 #crabka #authorization #acl #kafka #security

  71. mq-bridge-mcp

    MCP Server for mq-bridge

    v0.1.2 #amqp #kafka #mcp-server #publisher #mongo-db #nats #logging #mqtt #aws #artificial-intelligence

  72. streex

    Kafka store runner

    v0.1.12 #kafka #store

  73. crabka-cli

    Operator CLI for Crabka (binary: crabka)

    v0.3.8 110 #operator #kafka #cli

  74. axum-webtools-dlq-redrive

    Kafka DLQ redrive tool for axum web framework

    v0.1.58 #kafka #axum #dlq #redrive

  75. streamforge

    High-performance Kafka streaming toolkit with advanced filtering and transformation

    v1.0.0 #kafka #data-pipeline #streaming #mirror #etl

  76. crabka-grpc-gateway

    gRPC / Connect-RPC + HTTP gateway into Crabka (Kafka) topics

    v0.3.8 110 #grpc #crabka #connect-rpc #gateway #kafka

  77. merkql

    Embedded event log with Kafka-compatible semantics and merkle tree integrity verification

    v0.2.0 #merkle-tree #kafka #audit-logs #event-streaming #embedded

  78. schema-registry-client

    Serialize/deserialize data to/from Kafka using the Confluent Schema Registry

    v0.4.2 2.8K #protobuf #json-schema #kafka #avro

  79. flare-server-core

    Server-side infrastructure toolkit for Flare IM services: runtime, transport, messaging, auth, telemetry, and context propagation

    v1.0.3 #authentication #kafka #service #server-side #nats #flare #im #propagation #grpc-client #discovery-client

  80. sea-streamer-socket

    🌊 SeaStreamer backend-agnostic Socket API

    v1.0.0-rc.1 7.7K #stream-processing #kafka #async-stream

  81. madsim-rdkafka

    The rdkafka simulator on madsim

    v0.4.4+0.34.0 5.8K #kafka #simulation #rdkafka #async

  82. crabka-bench-driver

    Load driver + report aggregator for the Crabka vs Strimzi benchmark harness

    v0.3.8 110 #benchmark #crabka #kafka #load-test

  83. tansu-client

    A Service/Layer based Kafka client

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  84. sea-streamer-examples

    🌊 The stream processing toolkit for Rust

    v1.0.0-rc.1 #stream-processing #kafka #sea-streamer #redis #toolkit #batch-processing

  85. crabka-compression

    Kafka wire-protocol compression codecs for Rust

    v0.3.6 140 #kafka #wire-protocol #zstd #snappy

  86. crabka-remote-storage

    KIP-405 tiered-storage SPI (RemoteStorageManager / RemoteLogMetadataManager) and reference implementations for Crabka

    v0.3.8 270 #crabka #object-store #tiered-storage #kafka

  87. qm

    quick microservices in Rust

    v0.0.79 310 #microservices #mongo-db #quick #redis #keycloak #kafka #nats #amazon-s3

  88. kafka-backup-core

    Core engine for Kafka backup and restore operations with point-in-time recovery

    v0.15.8 #backup-restore #kafka #disaster-recovery #backup #restore #backup-recovery

  89. crabka-client-streams

    KIP-1071 Kafka Streams rebalance-protocol client for Apache Kafka in Rust

    v0.3.8 110 #kafka #crabka #client #stream

  90. testcontainers-redpanda-rs

    Unofficial redpanda test container

    v0.14.0 2.8K #test-containers #redpanda #kafka #testing #integration-testing

  91. kcr_kafka_stackable_tech

    Kubernetes Custom Resource Bindings

    v3.20260601.205325 #kubernetes-custom-resource-bindings #kafka #kubernetes-custom-resources

  92. bevy_event_bus

    A Bevy plugin that connects Bevy's event system to external message brokers like Kafka

    v1.1.4 #kafka #events #gamedev #bevy

  93. nisshi-cli

    Tansu CLI

    v0.6.0 #amazon-s3 #kafka #postgresql #iceberg

  94. sockudo-queue

    Queue manager implementations for Sockudo

    v4.7.0 #sockudo #deployment #websocket #rabbitmq #nats #real-time #redis #redis-cluster #pusher #kafka

  95. pg-tide-relay

    Bidirectional relay binary for pg_tide — bridges outboxes/inboxes with NATS, Kafka, HTTP webhooks, Redis, SQS, RabbitMQ, and more

    v0.39.0 #kafka #nats #relay #postgresql #streaming

  96. tiny_kafka

    A tiny Kafka client library with producer and consumer functionalities

    v1.0.6 300 #kafka #streaming #rust-client #producer-consumer #kafka-consumer

  97. kcr_kafka_services_k8s_aws

    Kubernetes Custom Resource Bindings

    v3.20260601.143835 #kubernetes-custom-resource-bindings #kafka #kubernetes-custom-resources

  98. nisshi-cat

    Fetch or produce (with validation when backed by a schema) messages to a topic

    v0.6.0 #amazon-s3 #kafka #postgresql #iceberg

  99. crabka-kraft-core

    Deterministic, sans-IO KRaft consensus core (KIP-595/996) for Crabka — wasm-friendly

    v0.3.8 140 #raft-consensus #raft #crabka #kafka #consensus #kraft

  100. crabka-metadata

    Versioned metadata record types + immutable image for Crabka

    v0.3.8 300 #crabka #metadata #kafka #kraft

  101. sockudo-adapter

    Connection adapters and horizontal scaling for Sockudo

    v4.7.0 #sockudo #websocket #deployment #delta-compression #redis-cluster #rabbitmq #nats #real-time #rate-limiting #kafka

  102. nisshi-topic

    Topic administration

    v0.6.0 #amazon-s3 #kafka #postgresql #iceberg

  103. netring-exporters

    Heavyweight anomaly exporters for netring (OTLP, Kafka) — kept out of the core crate

    v0.4.0 #otlp #kafka #open-telemetry #netring

  104. crabka-telemetry

    Generic OTLP distributed-tracing pipeline for Crabka services

    v0.3.8 260 #crabka #otlp #telemetry #kafka #tracing

  105. shotover

    API for building custom transforms

    v0.7.3 #transform-builder #kafka #cassandra #struct #topology #seperate

  106. pulse-ops

    Built-in operators and combinators for Pulse dataflows — map, filter, join, window, and custom processing logic

    v0.1.2 #data-streaming #operator #event-time #parquet #pulse #rocksdb #local-first #kafka #watermarks #windowing

  107. kafkang

    Rust client for Apache Kafka

    v0.3.0 #kafka #queue

  108. crabka-raft

    Metadata KRaft quorum (KIP-595 KraftController) for Crabka

    v0.3.8 200 #raft-consensus #crabka #raft #kafka #kraft

  109. sentry_usage_accountant

    Sentry application uses to account for usage of shared system resources broken down by feature

    v0.1.2 8.0K #shared-resources #system-resources #kafka #applications #amount #unit-of-measure #impact

  110. crabka-connect-postgres

    Postgres logical-decoding source connector for Crabka Connect

    v0.3.8 #postgresql #kafka #crabka #cdc

  111. crabka-logfmt

    Structured-JSON (Cloud Logging-friendly) tracing log formatter shared across Crabka services

    v0.3.8 210 #logging-tracing #crabka #kafka #json #logging

  112. nisshi-service

    Tansu protocol services and layers

    v0.6.0 #amazon-s3 #kafka #postgresql #iceberg

  113. nisshi-broker

    Tansu Kafka API compatible broker

    v0.6.0 #amazon-s3 #kafka #postgresql #iceberg

  114. flowly-kafka

    reusable kafka component for flowly

    v0.6.4 #kafka #async #pipeline #async-pipeline

  115. rs-broker

    rust broker

    v1.0.3 #kafka #broker-mq #rust-broker #broker

  116. negrdo-standard-messaging

    Standard messaging core library for Negrdo services — CloudEvents 1.0 compliant envelope management with pluggable broker adapters

    v1.0.0 #standard-messaging #rabbitmq #kafka #cloud-events

  117. tansu-auth

    Tansu Auth

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  118. faucet-sink-kafka

    Apache Kafka producer sink for the faucet-stream ecosystem

    v1.3.1 #kafka #sink #streaming #pipeline #streaming-pipeline

  119. yozefu-app

    The Kafka consumer of Yozefu

    v0.0.30 #kafka #avro #search #kafka-consumer

  120. crabka-client-producer

    Idempotent producer client for Apache Kafka in Rust

    v0.3.9 340 #kafka #crabka #streaming #client #client-streaming

  121. llm-optimizer-processor

    Data processing and transformation pipeline

    v0.1.1 #stream-processing #standard-deviation #data-processing #pipeline #deduplicate #exponential-moving-average #event-time #kafka #watermark #sliding-window

  122. nisshi-proxy

    A Kafka API Proxy

    v0.6.0 #amazon-s3 #kafka #postgresql #iceberg

  123. hermesmq-proto

    Protobuf wire types for hermesmq, shared by the server and clients

    v0.6.5 #message-queue #protobuf #client-server #kafka #hermesmq #prometheus #kafka-like #rate-limiting #docker

  124. outbox-kafka

    Kafka transport implementation for the oxide-outbox

    v0.2.1 #kafka #outbox #rdkafka #events #transaction

  125. osproxy-kafka

    Queue-backed traffic capture: serializes captured exchanges to a replay envelope and produces them through a Producer seam. The broker client composes in; this crate has no broker dependency.

    v1.0.3 #kafka #traffic-capture #broker #exchange #replay #produce-error #proxy #wire-format #in-memory

  126. crabka-voters

    KIP-853 voter-set value types for Crabka (id, directory-id, endpoints, kraft.version)

    v0.3.8 200 #raft #voter #kafka #crabka #kraft

  127. pulse-io

    Input/output connectors for Pulse — integrates with external systems such as Kafka, Arrow, and Parquet

    v0.1.2 #parquet #event-time #data-streaming #kafka #io #csv #rocksdb #local-first #windowing #flink

  128. crabka-client-consumer

    Subscribe-style consumer client for Apache Kafka in Rust

    v0.3.8 330 #kafka #crabka #streaming #client #client-streaming #kafka-consumer

  129. hiver-kafka

    Apache Kafka support for Hiver Framework. Hiver框架的Apache Kafka支持。 Equivalent to: Spring Kafka, Spring Cloud Stream

    v0.1.0-alpha.6 #kafka #async #hiver #framework #web-framework

  130. nisshi-client

    A Service/Layer based Kafka client

    v0.6.0 #amazon-s3 #kafka #postgresql #iceberg

  131. rdkafka-redux

    Rust wrapper for librdkafka

    v0.38.2 #kafka #rdkafka

  132. ds-event-stream-rs-sdk

    A comprehensive Rust SDK for working with the DS Event Stream, providing high-level abstractions for producing and consuming events from Kafka

    v1.0.0 #event-stream #kafka #sdk #async

  133. crabka-playground

    WebAssembly bindings driving Crabka's deterministic KRaft consensus simulator in the browser

    v0.3.8 #raft #kafka #raft-consensus #consensus #kraft #wasm

  134. kincir

    message streaming library inspired by Watermill

    v0.2.0 550 #message-broker #rabbitmq #message-streaming #logging #kafka #protobuf #message-handler #watermill #uuid #subscribing

  135. faucet-common-kafka

    Shared configuration types for the faucet-stream Kafka source and sink connectors

    v1.0.5 #kafka #etl-pipeline #streaming #faucet #pipeline #etl

  136. quarb-kafka

    Apache Kafka adapter for the Quarb query engine

    v0.11.0 #kafka #quarb #arbor #streaming #query

  137. yozefu-wasm-types

    Types and structures for defining WebAssembly modules

    v0.0.30 #kafka #search #avro #wasm #kafka-consumer

  138. flare-core-messaging

    Event bus and MQ primitives for Flare server applications, including NATS and Kafka support

    v1.1.0 #kafka #nats #event-bus #mq #flare #jetstream #error-context #im #service-discovery

  139. oxigdal-kafka

    Apache Kafka integration for OxiGDAL - async producer/consumer with schema registry and transactions

    v0.1.6 #kafka #async #streaming #science

  140. camel-component-kafka

    Kafka component for rust-camel integration framework

    v0.25.1 #kafka #streaming #camel #integration

  141. datum-mq

    Native Kafka sources and sinks for Datum streams

    v0.11.0 #kafka #datum #connector

  142. varpulis-connectors

    Connector implementations for Varpulis (MQTT, Kafka, NATS, HTTP, etc.)

    v0.11.0 #varpulis #mqtt #kafka #events #pattern-matching #nats #jvm #real-time #sec #single-binary

  143. kafka-remapper-core

    Core library for Kafka partition remapping proxy

    v0.5.6 #kafka #remapping #proxy #streaming

  144. kommitted

    Measure Kafka Consumer Offset Lag and Time Lag

    v0.3.1 430 #kafka #lag #kafka-consume #monitoring #performance

  145. tansu-cat

    Fetch or produce (with validation when backed by a schema) messages to a topic

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  146. tansu-topic

    Topic administration

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  147. lnmp-transport

    Transport bindings for LNMP protocol (HTTP, Kafka, gRPC)

    v0.5.16 #nats #lnmp #http-header #kafka #record #trace-id #w3c #trace-context #otel #transport-protocol

  148. lnc-client

    LANCE client library - Rust client for the LANCE streaming platform

    v0.2.8 #kafka #streaming #client-streaming #async

  149. pulse-state

    State management utilities for Pulse — provides windowing, aggregations, and persistent operator state

    v0.1.2 #data-streaming #operator #windowing #rocksdb #parquet #event-time #local-first #kafka #flink #prometheus

  150. kyu-copy

    Bulk data import for KyuGraph: CSV, Parquet, Arrow IPC, and Kafka readers

    v0.3.0 #graph-database #kyu-graph #arrow-ipc #csv #parquet #kafka #csv-reader #property-graph #full-text-search #nodejs

  151. xdl-database

    Database connectivity module for XDL - supports PostgreSQL, MySQL, DuckDB, SQLite, ODBC, Redis, and more

    v0.1.1 #mysql #postgresql #sqlite #kafka #duck-db #xdl #database #odbc #redis #database-connection

  152. sea-streamer-kafka

    🌊 SeaStreamer Kafka / Redpanda Backend

    v1.0.0-rc.1 7.3K #async-stream #stream-processing #kafka #async

  153. winterbaume-kafka

    Amazon MSK service implementation for winterbaume

    v0.2.0 #testing #mocking #kafka

  154. reinhardt-streaming

    Backend-agnostic streaming abstraction with Kafka support

    v0.3.0 320 #reinhardt #kafka #dependency-injection #rest #streaming #orm #backend-agnostic #websocket #graphql #serialization

  155. spring-stream

    Integrate sea-streamer with spring-rs

    v0.4.3 #kafka #stream-processing #spring #redis-stream

  156. osproxy-capture

    The traffic-capture seam: a Capture trait an external recorder (e.g. a Kafka writer) implements, with composable redaction. No broker dependency.

    v1.0.1 #traffic-capture #recorder #proxy #redaction #kafka #opensearch #strip #durable-stream #in-memory

  157. tansu-cli

    Tansu CLI

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  158. crab-kafka

    Forward <TCP|UDP> + TLS traffic to kafka

    v0.0.10 650 #tls #kafka #udp #tcp

  159. hermesmqd

    hermesmq server daemon: a Raft-replicated message queue

    v0.8.0 #message-queue #raft-replicated #kafka #daemon #hermesmq #metrics #kafka-like #prometheus #rate-limiting #protobuf-codegen

  160. varpulis-connector-kafka

    Kafka connector for Varpulis CEP engine

    v0.10.0 #varpulis #kafka #connector #cep #engine #sink-connector #kafka-topic #vpl #rdkafka #live-demo

  161. oxirs-stream

    Real-time streaming support with Kafka/NATS/MQTT/OPC-UA I/O, RDF Patch, and SPARQL Update delta

    v0.3.1 #kafka #opc-ua #mqtt #industry40

  162. miffy

    shadow-testing proxy: Send requests to a "reference" implementation, send the request to a "candidate" implementation, always respond with the "reference" implementation and log/publish…

    v1.0.1 210 #send-request #reference #candidate #proxy #requests #logging #respond #kafka

  163. pulse-core

    Core runtime and dataflow engine for Pulse — defines execution graph, operators, and streaming primitives

    v0.1.2 #prometheus #event-time #parquet #data-streaming #operator #rocksdb #kafka #metrics #local-first #windowing

  164. tansu-broker

    Tansu Kafka API compatible broker

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  165. rastreo-server

    HTTP control plane for rastreo — enrichment-aware network discovery

    v0.9.0 #kafka #discovery #observability #snmp

  166. snakeice-rdkafka

    Rust wrapper for librdkafka

    v0.40.2 #kafka #rdkafka

  167. streamling-e2e

    End-to-end tests for streamling

    v0.1.0 #testing #streamling #e2e-testing #end-to-end #postgresql #clickhouse #kafka #test-run #database #test-framework

  168. easy-config-def

    defining and validating application configurations, inspired by Apache Kafka's ConfigDef

    v0.1.6 #validation #config #config-def #kafka #applications #ci

  169. tansu-proxy

    A Kafka API Proxy

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  170. rivven-schema

    Schema Registry for Rivven - Confluent-compatible schema management

    v0.0.22 #schema-registry #json-schema #protobuf #kafka #avro #avro-schema

  171. llingr-nexus

    Contracts for the llingr Rust message-processing ecosystem: message, traits, metrics, handler traits

    v0.10.0 #kafka #contract #redpanda #streaming

  172. rdkafka-autoschematic-fork

    Rust wrapper for librdkafka

    v0.38.0 #kafka #rdkafka

  173. evoxy-bridge

    The async fan-out bridge (ADR-005): turns an Envoy-mirrored request into a Kafka record over osproxy's Producer seam. A separate deployment artifact, not the Envoy extension.

    v1.0.0 #kafka #deployment-artifact #envoy #bridge #fan-out #request-path #in-memory #plugs #mirrored

  174. tinyflow-api

    Core traits, types, and abstractions for Tinyflow streaming framework

    v0.1.1 #data-pipeline #streaming #iceberg #kafka #etl #etl-data-pipeline

  175. clamber-web-core

    clamber web core

    v0.1.3 190 #sea-orm #kafka #clamber #redis #axum

  176. summer-stream

    Integrate sea-streamer with summer-rs

    v0.7.1 #kafka #stream-processing #summer #redis-stream

  177. crabka-ids

    Canonical newtypes for Crabka's cross-crate Kafka identifiers (offset, partition index, …)

    v0.3.8 #kafka #crabka #newtype #offset

  178. kafrust-protocol

    Kafka wire protocol primitives for kafrust

    v0.2.1 #kafka #client #protocols #async

  179. br-cache

    Cache and Message Queue abstraction layer

    v0.3.22 100 #cache #kafka #br #redis

  180. kafka-api

    Manual implementation of Apache Kafka API in Rust

    v0.4.1 480 #kafka #manual-of-apache #api #data

  181. nisshi-generator

    Generate fake data for schema backed topics

    v0.6.0 #amazon-s3 #kafka #postgresql #iceberg

  182. mlua-rdkafka

    Mlua support for rdkafka

    v1.0.0 310 #rdkafka #mlua #kafka #lua

  183. kacrab-protocol

    Kafka wire protocol types — generated from upstream message schemas by kacrab-codegen

    v0.3.0 #kafka #wire-protocols #protocols #serialization #codec

  184. katla

    data flow generator

    v0.1.0-rc.0 #dataflow #generator #elasticsearch #kafka #mq #time-schedule #appender #json-format #appenders

  185. warpin-event-bus

    Generic async event bus abstraction with Kafka and no-op backends

    v0.2.2 #event-bus #abstraction #kafka #events #generic #caller #rdkafka #logging #populating #tenant

  186. fakecloud-kafka

    Amazon MSK (Managed Streaming for Apache Kafka, kafka) implementation for FakeCloud

    v0.44.4 #kafka #aws-sdk #control-plane #authentication #fakecloud #arn #container-runtime #msk #smithy #host-port

  187. yozefu-lib

    Core library of yozefu

    v0.0.29 #kafka #avro #search #kafka-consumer

  188. qm-kafka

    Kafka helper functions

    v0.0.78 #events #kafka #helper #kafka-topic #microservices

  189. rmqtt-bridge-egress-kafka

    Bridge remote KAFKA in egress mode

    v0.21.0 #rmqtt #kafka #message-queue #mqtt #mode #egress #message-broker #mqtt-broker #iot #concurrency

  190. nisshi-auth

    Tansu Auth

    v0.6.0 #iceberg #kafka #postgresql

  191. llm-analytics-hub

    Enterprise-grade analytics hub for LLM ecosystem monitoring with Kafka, TimescaleDB, Redis, and Kubernetes orchestration

    v0.1.0 #llm #kafka #timescaledb #kubernetes #analytics

  192. gcn-kafka

    Kafka client for NASA's General Coordinates Network (GCN)

    v1.0.0 #kafka #networking #aerospace

  193. rumqttlog

    kafka inspired rumqtt's mqtt commitlog

    v0.9.0 1.4K #kafka #iot #nats #distributed #mqtt

  194. osproxy-kafka-krafka

    Portable, pure-Rust Kafka Producer for osproxy-kafka over krafka + rustls. The TLS crypto provider is build-selected (ring for non-fips, the validated aws-lc-rs FIPS module for fips)…

    v1.0.0 #tls #client #fips #kafka #crypto-provider #rustls-aws-lc-rs #proxy #client-config

  195. kafcat

    cat but with kafka

    v0.1.3 #kafka #kafka-topic #json-format #async #cat #import-export

  196. caudal-sdk

    Caudal SDK - Event observability for distributed systems

    v0.1.0 #distributed-systems #kafka #events #observability

  197. qm-utils

    functions and macros

    v0.0.78 #macro #qm #microservices #mongo-db #macro-derive #cheap-clone #redis #keycloak #kafka

  198. qm-s3

    S3 helper functions

    v0.0.79 #qm #microservices #helper #amazon-s3 #mongo-db #redis #keycloak #kafka

  199. rusoto_kafka

    AWS SDK for Rust - Managed Streaming for Kafka @ 2018-11-14

    v0.48.0 #aws-sdk #kafka #aws

  200. schema_registry_converter_sf

    just a fork of the original schema_registry_converter crate with a fix for the avro serialization

    v4.1.0 #json-schema #protobuf #kafka #avro

  201. rskafka_wasi

    A minimal Rust client for Apache Kafka

    v0.3.1 #kafka #protocols #async

  202. tansu-generator

    Generate fake data for schema backed topics

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  203. kcli

    A Kafka client CLI tool for debugging and inspecting Kafka clusters

    v0.1.0 #kafka #broker #publish #debugging-tool #topic #cache #negotiation #kc #command-line-tool

  204. kafka-http

    Kafka HTTP client to allow a rust native way to interact with the restful kafka HTTP proxy

    v0.1.2 #kafka #rest-client #proxy #http-proxy #proxy-client #rust-native

  205. rmqtt-bridge-ingress-kafka

    Bridge remote KAFKA in ingress mode

    v0.21.0 #kafka #bridge #ingress #rmqtt #message-broker #mqtt #kafka-topic #mqtt-broker #register-plugin

  206. talos_rdkafka_utils

    RD Kafka utilities used in Talos

    v0.3.18 #kafka #talos #rd #utilities #github #home-page

  207. mlua-kafka

    An rdkafka-based implementation of LuaRocks chensoft/kafka for mlua

    v1.0.0 480 #kafka #rdkafka #mlua #lua

  208. tansu-perf

    Performance producer/consumer

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  209. br-kafka

    kafka queue

    v0.3.2 500 #kafka #queue #br #carryxd

  210. ene_kafka

    Ene Kafka is an easy-to-use Rust client for Apache Kafka

    v0.2.0 260 #kafka #microservices #ene-rs

  211. tansu-otel

    Tansu OTEL common configuration

    v0.6.0 #amazon-s3 #kafka #delta-lake #postgresql

  212. drasi-source-kafka

    Kafka source plugin for Drasi

    v0.1.4 #drasi #kafka #plugin

  213. redpanda-transform-sdk

    authoring Redpanda Data Transforms

    v1.1.0 950 #data-transform #kafka #redpanda #wasm

  214. sprue

    Streaming and message queue client CLI for Kafka, NATS, and Redis Streams. Part of the rustpunk portfolio.

    v0.1.0-alpha #rustpunk #kafka #cli

  215. fluxmq

    High-performance message broker and streaming platform inspired by Apache Kafka

    v0.1.0 #kafka #message-broker #message-streaming #distributed #async

  216. llm-optimizer-collector

    Metrics and data collection from LLM systems

    v0.1.0 #metrics-collection #llm #performance-metrics #circuit-breaker #devops #prometheus #kafka #backpressure #event-processing #system-configuration

  217. seesaw-kafka

    Kafka backend for Seesaw event-driven orchestration

    v0.12.0 #kafka #event-driven #workflow-orchestration #orchestration #workflow #event-driven-workflow

  218. kafka-threadpool

    An async rust threadpool for publishing messages to kafka using SSL (mTLS) or PLAINTEXT protocols

    v1.0.12 #tls #kafka #thread-pool #publish #mtls #plain-text #kafka-topic #env-vars

  219. merkql-notify

    Notification trait and types for merkql event streaming

    v0.1.0 #notifications #event-streaming #kafka #webhook

  220. prometheus-extensions

    Prometheus extensions: AggregateCounter (per-label + total metrics), scientific-notation encoder, and EMA sensor

    v0.1.0 #prometheus #metrics-monitoring #kafka #metrics #monitoring

  221. yozefu-tui

    rendering the TUI of Yozefu

    v0.0.30 #kafka #kafka-consumer #terminal

  222. event-notification

    A modular event notification system with multi-channel support

    v0.4.1 110 #kafka #webhook #events
  223. Try searching with DuckDuckGo.


  224. konsumer_offsets

    parse the content of the Kafka __consumer_offsets internal topic

    v0.3.2 460 #kafka #consumer-offsets #parser #apache

  225. merkql-notify-sqs

    AWS SQS notification plugin for merkql

    v0.1.0 #kafka #aws #event-streaming

  226. merkql-notify-sns

    AWS SNS notification plugin for merkql

    v0.1.0 #kafka #event-streaming #sns #aws

  227. rust_kafka_like

    A Kafka-like message broker in Rust

    v0.1.0 #message-broker #kafka #rust #broker

  228. krishiv-api

    Krishiv — hybrid batch and streaming compute engine

    v0.1.0-nightly.202607030148 #sql #dataframe #streaming-pipeline #compute-engine #krishiv #kafka #user-facing #iceberg #hybrid #api-surface

  229. franz

    friendly, and blazingly fast alternative to Apache Kafka

    v0.7.5 1.0K #kafka #ring-buffer

  230. jedisct1/flowgger

    fast, simple and lightweight data collector

    GitHub 0.3.3 #data-collector #logging #kafka #validation #redis #graylog #udp #capnp #gelf #ltsv

  231. high-level-kafka

    High Level Kafka client for Rust

    v1.0.0 430 #kafka #high-level #rdkafka #client #kafka-client

  232. streambed

    core library components

    v0.13.0 #secret-store #hashicorp-vault #service #commit-log #logging #kafka

  233. unis-kafka

    unis框架的Kafka实现。

    v0.2.0 #kafka #unis #unis框架 #kafka实现

  234. rill-core-actor

    Actor model infrastructure for the Rill ecosystem

    v0.5.0-beta.7 #actor-model #rill #actor-system #ecosystem #infrastructure #actor-ref #stream-processing #erlang-otp #lock-free #kafka

  235. rsflow

    High-performance Rust flow processing engine

    v0.1.0 #artificial-intelligence #kafka #sql #stream-processing-engine #data-processing #redis #real-time-data-processing #nats #websocket #duck-db

  236. kafka-replicator

    Application for replication data between kafka clusters

    v0.5.1 #kafka #replication #observer

  237. streambed-logged

    Logged is a small library that implements a file-system-based commit log

    v0.13.0 440 #logging #commit-log #streambed #kafka #file-system-based #retention

  238. arkflow

    High-performance Rust flow processing engine

    v0.1.0 #stream-processing #data #stream-processing-engine #sql #protobuf #kafka #mqtt #data-fusion #artificial-intelligence

  239. kawadb-broker

    High-performance Kafka-compatible message broker

    v0.1.0 #message-broker #kafka #kafka-compatible #tcp #tls #statistics #binary-protocol #tcp-server #kawa #database-engine

  240. krishiv-runtime

    Krishiv — hybrid batch and streaming compute engine

    v0.1.0-nightly.202607030148 #flight-sql #batch #compute-engine #krishiv #run-time #single-node #kafka #hybrid #session-state

  241. kmailbox

    kafka mailbox

    v0.1.6 440 #kafka #mailbox

  242. eventuary-kafka

    Apache Kafka event backend for eventuary

    v0.2.0 #kafka #events #streaming

  243. merkql-notify-webhook

    HTTP webhook notification plugin for merkql

    v0.1.0 #notifications #kafka #webhook #event-streaming

  244. armature-messaging

    Message broker integrations for the Armature framework - RabbitMQ, Kafka, NATS, and AWS SQS/SNS

    v0.1.0 #rabbitmq #nats #kafka