Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.

A JVM written in Scala

Real Time Analytics and Data Pipelines based on Spark Streaming

Persistent and in-memory key-value storage engine for JVM that scales on a single machine.

pg2sqlite is easy to use solution to create sqlite database from postgresql dump

A workflow management system for researchers who heart Unix.