A FastAPI-based backend that validates whether a directed graph is a Directed Acyclic Graph (DAG) using Kahn’s Algorithm. It integrates with the Flowcraft frontend to analyze graph pipelines.
-
Updated
Feb 4, 2025 - Python
A FastAPI-based backend that validates whether a directed graph is a Directed Acyclic Graph (DAG) using Kahn’s Algorithm. It integrates with the Flowcraft frontend to analyze graph pipelines.
Automated ETL pipeline that collects weather data from OpenWeather API and integrates it with city demographic information using Apache Airflow, AWS RDS PostgreSQL and S3.
Built a full-stack data engineering pipeline on Snowflake to process and transform 10M+ daily e-commerce records for ML model training.
Example MLOps/ML-training pipeline running with no cloud infrastructure except a public personal (free) Github acount.
An extension enabling the monitoring of Apache Airflow DAGs directly from Jupyter notebooks. Tailored for developers and data scientists, it simplifies tracking specific DAGs, reduces unnecessary friction, and allows severity levels setup for failed DAGs.
automated data pipeline using beautiful soup, apache airflow and dvc data versioning
This data pipeline project focuses on ingesting and processing raw stock market data, performing feature engineering on top of the processed data, training a predictive model, and building an API service to serve the trained model.
Use Apache Airflow to Extract Transform and Load sample data
airflowazapp ♻️ : Airflow #azure_web_app #dag
A real-time analytics platform for restaurant data
Workflow Management for ResearchKernel || AIRFLOW || We do not use this anymore
A collection of the assignments in the course advanced machine learning
Publishing PyPI packages for Apache Airflow
A show case repository to use airflow, dbt and data warehouse systems in order to perform an ELT task.
This dataset contains information about the customer and its location. You can use this dataset to identify unique customers in the order dataset and find the delivery location of orders.
Manually trigger an Airflow DAG that logs the execution time, using a Docker-based setup with Airflow 2.x.
Add a description, image, and links to the dag topic page so that developers can more easily learn about it.
To associate your repository with the dag topic, visit your repo's landing page and select "manage topics."