COVID 19 Data Pipeline - Azure Data Engineering: A complete end-to-end ETL pipeline to fetch COVID19 daily and weekly data from API, transform and load to SQL database in Azure using Data Factory, Databricks, Key-Vaults and Data Lake
How flows of data reveal the ecosystems of our planet
small ETL library to convert MRASCO & SPAA UK energy industry dataflows into csv
This repository serves as a personal collection of Power BI Dashboard and Report sample files, along with the datasets used in the samples, tutorials, and other related content.
The RaftLib C++ library, streaming/dataflow concurrency via C++ iostream-like operators
COVID19 Data Pipeline: An end-to-end ETL data pipeline to fetch daily and weekly Covid data from API, transform and load it into SQL database using some of the Azure services.
This project is a dataflow application that fetches Google Search Trends using Fluvio.
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
Created a Risk Assessment Report, Threat Modeling Report, Network & Data Security Report, Third-Party Risk Report, Incident Response Plan, Business Continuity Plan, and Executive Summary for VISION (All entities and events in this case study are purely hypothetical. Details of the case study are inspired by real-world events.)
Templated modern C++ library for implementing DataFlow programming
[ICLR 2025 Spotlight] LayerDAG: A Layerwise Autoregressive Diffusion Model of Directed Acyclic Graphs
Easy and lightweight parallelized dataflows in Python
This project demonstrates the development of a robust batch processing pipeline designed to handle large-scale data ingestion and transformation.
Big Data CONFERENCE Europe 2025 🇱🇹 AI, Cloud and Data Conference - Build Your First End-to-End Lakehouse Solution (aka.ms/fabconlake)
Serverless Power BI connector for Smokeball — built with Azure Functions, Blob Storage & OAuth2 token rotation. Enables automated scheduled refreshes in Power BI Service via Dataflows.
Three Microsoft Fabric projects collected in one place, showcasing practical end-to-end data engineering workflows. Built primarily with Microsoft Fabric services like dataflowgen2, datafactory, pyspark-notebooks , covering ingestion, transformation, and orchestration patterns in Fabric.
Add a description, image, and links to the dataflows topic page so that developers can more easily learn about it.
To associate your repository with the dataflows topic, visit your repo's landing page and select "manage topics."