dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks

Apache Spark Kubernetes Operator

Apache Spark - A unified analytics engine for large-scale data processing

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and provi…

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

A self-contained dbt project for testing purposes

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

An application metrics facade for the most popular monitoring tools. Think SLF4J, but for metrics.

Curated Big Data Applications for Kubernetes

🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.

Open source SQL Query Assistant service for Databases/Warehouses

Apache Hive

Mirror of Apache Kafka

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

ChatGPT SDK and CLI for Java

An Open Standard for lineage metadata collection

GPT-powered chat for documentation search & assistance.

APM, Application Performance Monitoring System

Java client for Kubernetes & OpenShift

Mirror of Apache Cassandra

KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes