The Open-Source Enterprise Data Platform in a single Portal

Spark Connector to read and write with Pulsar

pulsar lakehouse connector

Kubernetes (K8s) Operator for PrestoDB

Apache Pinot - A realtime distributed OLAP datastore

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Upserts, Deletes And Incremental Processing on Big Data.

Apache Iceberg

Low level, multiprocessing based AWS Kinesis producer & consumer library

Watch k8s events and trigger Handlers

Vagrantfile with docker cluster provisioning script