Apache Airflow CI pipeline

Parcel for Apache Airflow

Multi-docker container data science / engineering playground (w/ Kafka, Airflow, MLFlow, Tensorflow-Keras / SKLearn) for simulating a microservices-oriented architecture

Dockerfile to extend Airflow docker image(s) to support Microsoft SQL Server

Docker Image for Airflow with MS SQL and pyodbc support

Airflow, Spark and Kafka example

Apache Airflow IDE with Kubernetes Operator capabilities

A simple container to run Apache Airflow on Windows machines.

Docker Image packaging for Apache Airflow

Bigdata stack include spark, airflow run on k8s

Template project for thepipelinetool

BigData Pipeline is a local testing environment for experimenting with various storage solutions (RDB, HDFS), query engines (Trino), schedulers (Airflow), and ETL/ELT tools (DBT). It supports MySQL, Hadoop, Hive, Kudu, and more.

My own docker images, for programs and applications I typically use, but haven't found a good docker image yet, so I made my own. They are for personal use, and still in development.

MINI-DATALAKE is a containerized big-data platform for data processing in Spark, scheduling in Airflow, storing in Hadoop HDFS and data query with Hue

Docker Apache Airflow

Helm Chart to bootstrap an airflow cluster on Kubernetes using the KubernetesOperator.

Airflow 2.1 docker template.

Deploy Apache Airflow inside Docker containers

Playground for DataLake (Hadoop, Hive, Kudu, Trino, Hue, Airflow, DBT)