Apache Spark - A unified analytics engine for large-scale data processing

PredictionIO, a machine learning server for developers and ML engineers.

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Integration of TensorFlow with other open-source frameworks

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs