Apache Kafka® running on Kubernetes

Apache InLong - a one-stop, full-scenario integration framework for massive data

An extensible distributed system for reliable nearline data streaming at scale

Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

Sample code that shows the important aspects of developing custom connectors for Kafka Connect. It provides the resources for building, deploying, and running the code on-premises using Docker, as well as running the code in the cloud.

Sample Applications for Pravega.

Kafka Connector for Apache Doris

Example projects and demos around data streaming , stream processing, change data capture, and more.

A simple, time-tested, family of random hash functions in Java, based on CRC32, affine transformations, and the Mersenne Twister. 🎲

Kafka to ClickHouse sink connector for streaming event data into ClickHouse from Kafka topics.

Serverless + Distributed + Event-driven MVP

Real-time data streaming implementation with AWS Kinesis.

Data processing pipeline for detection of motion based events in a stream of real-time location updates

Erebus: Explaining the Outputs of Data Streaming Queries

This Java program read data from a weather station (Davis Vantage Pro2) and store it in a SQL database

A real-time data processing project for analyzing e-commerce sales data. It integrates Apache Kafka 📡 and Apache Spark ⚡ to extract brand information and calculate the top N brands. Results are stored in HBase and displayed in real-time ⏱️. This project enables seamless integration with visualization tools 📊, offering insights into brand trends.

The missing command line interface for Jet:

Stream MongoDB documents to Kafka with real-time CDC, resumable processing, and production-ready resilience patterns

This repository serves as a collection of projects demonstrating expertise in Apache Kafka, a distributed event-streaming platform. The projects aim to highlight real-time data integration and stream processing solutions.