Python Streaming DataFrames for Kafka

A cloud native embedded storage engine built on object storage.

LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.

Tool to build & run portable, lightweight, self-contained virtual machines.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.

Apache DataFusion SQL Query Engine

Extremely fast Query Engine for DataFrames, written in Rust

Zero-copy deserialization framework for Rust

Official Rust implementation of Apache Arrow

🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platfor…

Apache Iggy: Hyper-Efficient Message Streaming at Laser Speed

Library for bringing distributed capabilities to Apache DataFusion

Comptaction runtime for Apache Iceberg.

🗻 Log-structured embeddable key-value storage engine written in Rust

K.I.S.S. LSM-tree implementation in safe Rust

The Feldera Incremental Computation Engine

Value log implementation for key-value separated storage in safe Rust

Thin immutable zero-copy byte slice

A course of building an LSM-Tree storage engine (database) in a week.

An educational OLAP database system.

Design documents for distributed DBSP

A MVP implementation of distributed query engine cut from datafusion-ballista codebase for learning purpose.

Mini-LSM solution checkpoint