SparkER: an Entity Resolution framework for Apache Spark

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

A simplified, lightweight ETL Framework based on Apache Spark

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

System design patterns for machine learning

World countries in JSON, YAML, CSV and XML. Any help is welcome!

A simple Spark-powered ETL framework that just works 🍺

Moonbox is a DVtaaS (Data Virtualization as a Service) Platform

Essential Spark extensions and helper methods ✨😲

Distributed Deep Reinforcement Learning Traffic Signal Control

EMNLP 2018: RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information

Solving Haxball (www.haxball.com) using Imitation Learning methods.

Reinforcement Learning environments for Traffic Signal Control with SUMO. Compatible with Gymnasium, PettingZoo, and popular RL libraries.

This is an application exploiting principles of Deep Reinforcement Learning. The Deep Neural Network is trained to approximate the Bellman Equation (Q-Learning).