Stars
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
An implementation of Git Remote Helper that makes it easier to interact with AWS CodeCommit
The AWS Deployment Framework (ADF) is an extensive and flexible framework to manage and deploy resources across multiple AWS accounts and regions based on AWS Organizations.
Let me google that for you CLI tool to easily create and share lmgtfy links
A MNIST-like fashion product database. Benchmark 👇
🐘 Elasticsearch real-time search and analytics natively integrated with Hadoop