Web UI for monitoring and managing Karafka consumers

Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.

Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.

Open-source graph database, tuned for dynamic analytics environments. Easy to adopt, scale and own.

Fancy stream processing made operationally mundane

📡 Build a robust streaming data pipeline using Docker, Kafka, Spark, and Cassandra for real-time ingestion, processing, and analytics.

🚀 Explore job runner implementation in Elixir, improved from a decade ago. Ideal for both learners and seasoned developers looking for a practical case study.

A lightweight utility for Node.js projects that accumulates items into fixed-size batches per key, preserving insertion order within each key. Streams items directly into their respective batches at runtime, eliminating the overhead of post-processing 1D arrays into chunks. It abstracts key-based batch management.

A curated list of awesome big data frameworks, resources and other awesomeness. With repository stars⭐ and forks🍴

Efficient XML Interchange (EXI) Embeddable C API

Utils for streaming large files (S3, HDFS, gzip, bz2...)

Open-Source Web UI for managing Apache Kafka clusters

Open source content for the Redpanda documentation

Redpanda Cloud documentation

This repository demonstrates how to use Python Generators with a PostgreSQL database to process large datasets efficiently

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

a payment application intended for deployment by the united states treasury that replaces banking with accounting

Blog about Apache Kafka, Apache Flink and Java

StreamingStats is a Ruby class that takes streaming numeric data and return descriptive statistics with minimal overhead.

Python Streaming DataFrames for Kafka