Stars
Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, a…
AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.
Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
Uniffle is a high performance, general purpose Remote Shuffle Service.
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Apache Spark - A unified analytics engine for large-scale data processing
The Context Platform for your Data and AI Stack
An easy to use, self-service open BI reporting and BI dashboard platform.
High Performance Inter-Thread Messaging Library
Benchmark comparing serialization libraries on the JVM