This is a repo with links to everything you'd ever want to learn about data engineering

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Reccomender System Creation for Kaggle's OTTO challenge