Broadway is a distributed actor-based processing server optimized for high-speed data/file ingestion

A distributed processing/orchestration server and ETL for NodeJS

Simple Journaling Queue Library

A light Kafka to HDFS/S3 ETL library based on Apache Spark

Ignite your Spark ETL jobs

Out of the box scheduling, logging, monitoring and data governance for your scala ETL jobs.

A tool to read data from database then write data into database,html,csv,excel .Can select from cache like memory.

Enron Email ETL

ETL Data with Spark

A standalone ETL tool to generate advanced features for your Machine Learning projects

Scala library for building ETL pipelines in functional way.

An opinionated way to structure ETL pipelines with a heavy focus on reusability and testing

Simple Spark project built in Scala

A project to use spark for transform the *.n3 file to CSV file

简单易用的ETL工具

ETL Runner using FS2 and Cats

基于Akka实现的数据实时流式同步的应用,支持高可用

生产环境的海量数据计算产品，文档地址：

Mole is a spark library which support designing and implementing ETL work in a configuration file to avoid spending additional time to repackage and deploy the submitted jar for general changes(such as source/sink location and transformations).

Cross database data transfer tool