Automatically visualize the input/output of Stata code.

Data pipeline with Apache Airflow - Data Engineering Nanodegree (DEND) 5th Project

controlmdag Ⓜ️🗡️ : BMC Control-M Migration # Control M # Apache Airflow # DAGify # Composer

airflowazapp ♻️ : Airflow #azure_web_app #dag

A real-time analytics platform for restaurant data

This data pipeline project focuses on ingesting and processing raw stock market data, performing feature engineering on top of the processed data, training a predictive model, and building an API service to serve the trained model.

Use Apache Airflow to Extract Transform and Load sample data

A lightweight Python DAG workflow orchestrator with async execution, persistent state, and Mermaid.js visualization.

A sample Airflow DAG that fetches city data from Divar API and saves it as CSV.

Causal ML for Swiss aFRR price spike prediction — German wind forecast errors → unplanned loop flows → balancing cost spikes. XGBoost + SHAP + MLflow + Databricks + Airflow pipeline with PSI drift monitoring and champion/challenger retraining.

🗣️ Intelligent Multi-Agent Debate System built with LangGraph & Groq. Simulates structured arguments between AI personas (Scientist vs. Philosopher) with an automated AI Judge and DAG visualization.

Automated ETL pipeline that collects weather data from OpenWeather API and integrates it with city demographic information using Apache Airflow, AWS RDS PostgreSQL and S3.

A FastAPI-based backend that validates whether a directed graph is a Directed Acyclic Graph (DAG) using Kahn’s Algorithm. It integrates with the Flowcraft frontend to analyze graph pipelines.

Py-Daga: Saga DAGs Made Easy

A self-healing text classification pipeline built with LangGraph and a fine-tuned DistilBERT (LoRA) model. The system uses prediction confidence to decide whether to accept, reject, or trigger a fallback (user clarification or alternative strategy). Designed with a clean CLI, structured logging, and human-in-the-loop reliability. Demo video:

Build, run, and monitor data pipelines visually. Like Airflow, but you can actually set it up in 5 minutes.

轻易云 QDataV2 官方适配器：无缝连接金蝶云·星瀚/苍穹 (kd-galaxy) 平台。支持实时数据同步、批量 ETL、API 标准化封装。

Lightweight, accessible composite data structures for Python

Implementation of Different Advanced Algorithms