etl-automation

Zero-ETL analytical replica for MySQL, RDS and Aurora. Reads the binlog like a replica, keeps Parquet in your bucket, opens in DuckDB. Time travel and row-level undo included.

Extract specific information from webpage. Run in standalone mode or as API.

A high-performance Go library for building complete ETL (Extract, Transform, Load) directed-acyclic graph pipelines. GoETL provides streaming data readers, configurable transformations, and efficient writers with a fluent API for complex data workflows.

Distributed ETL pipeline engine. Import, clean, normalize and deduplicate at scale.

A comprehensive manager designed to streamline data extraction, transformation and loading processes across all popular databases!

YAML in. Data out.

Scheduled jobs to load the database with student login data.

SSIS like, XML-driven multi-database pipeline executor and ETL engine written in Go. This tool enables developers to define complex, high-performance data processing pipelines that seamlessly combine interpreted Go scripts (executed in-memory via Yaegi) and SQL queries across multiple heterogeneous database engines.

flow is an SSIS-like and embeddable data pipeline orchestration and stream ETL library for Go. It allows developers to programmatically load, validate, and execute complex pipeline AST nodes (such as loops, parallel batches, and dynamic SQL/Go scripts) from XML configuration files.