Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines
-
Updated
Apr 9, 2026 - Python
dlt is an open source Python library that loads data from various, often messy data sources into well-structured, live datasets.
It offers a lightweight interface for extracting data from REST APIs, SQL databases, cloud storage, Python data structures, and many more.
It is NOT related to Delta Live Tables or distributed ledger technology.
Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines
基于tensorflow lstm模型的彩票预测
The Metadata Driven framework for Databricks Lakeflow Declarative Pipelines (formerly Delta Live Tables). Metadata framework that generates production ready Pyspark code for Lakeflow Declarative Pipelines
A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT run and Non-DLT interactive notebook run.
An implementation of Direct Linear Transform for 3D to 2D mapping.
Databricks DLT Apparel Pipeline Project: Learn medallion architecture, streaming, and data engineering with Delta Live Tables. Includes synthetic data, step-by-step guide, and certification prep.
Personal project for setting up an open source data warehouse.
FinOps repository: An open-source framework for multi-cloud cost visibility. Extendable with dlt.
Use Databricks to improve the Claims Management process for faster claims settlement, lower claims processing costs and quicker identification of possible fraud
IOC matching for incident responders, threat hunters, detection engineers, and security engineers.
Data engineering demo project for Danish Parliament (Folketing) open data — dlt extraction, dbt + DuckDB/MotherDuck transformation, Delta Lake export to Microsoft Fabric OneLake
Usage of direct linear transformation (camera calibration and point reconstruction) for accurate motion analysis in biomechanical applications.
From display to video, the value of an impression can only be realized if an ad is viewed by a user. Therefore, when using programmatic advertising to buy inventory, it’s important to take viewability into account. In this Solution Accelerator, learn how to predict ad viewability to optimize your real-time bidding strategy.
The code to follow along our tutorials for the dlt rest_api source
An Iceberg destination for DLT that supports REST catalogs
For creating a panorama from multiple images
Created by data-load-tool
Released February 2023
Latest release 22 days ago