An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

The leader in Customer Data Infrastructure

Apache OpenWhisk is an open source serverless cloud platform

Principled Functional Programming in Scala

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

GeoMesa is a suite of tools for working with big geo-spatial data in a distributed fashion.

Data Lineage Tracking And Visualization Solution

πflow is a big data flow engine with spark support

A simple Spark-powered ETL framework that just works 🍺

A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml