Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

A modular SQL linter and auto-formatter with support for multiple dialects and templated code.

A tool for generating .pex (Python EXecutable) files, lock files and venvs.

Titan Core - Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool f…

S3 transport for APT

A pure Python protobuf parser

TraitBasis applied to TauBench

Code for reproducing the CatAttack pipeline of adversarial triggers for reasoning models

Dang. (NOTE: This project has moved to https://github.com/getcloudless/cloudless)

Hue is a browser-based desktop interface for interacting with Hadoop. It supports a file browser, job tracker interface, cluster health monitor, and more.