Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

A system for agentic LLM-powered data processing and ETL

Scalable and efficient data transformation framework - backwards compatible with dbt.

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

dbt + Metabase integration

One framework to develop, deploy and operate data workflows with Python and SQL.

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

PyAirbyte brings the power of Airbyte to every Python developer. Powers the Airbyte Cloud Replication MCP.

CLI tool for dbt users to simplify creation of staging models (yml and sql) files

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

Airbyte made simple (no UI, no database, no cluster)

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

A SQLite adapter plugin for dbt (data build tool)

Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

Python based Wikidata framework for easy dataframe extraction