Case Santander

CLI tool for querying JGI Dremio Lakehouse

Postgres > Kafka Connect (Debezium) > Kafka > Kafka Connect > Iceberg + Nessie + Minio <<< Dremio

A sample setup modern data lakehouse with MinIO as S3 Like, Nessie for data catalog and version control system to data lake, Dremio as Query Engine for SQL Like to catalog lakehouse, Apache NiFi as data streaming to handle ETL process, Metabase as visualization dashboard to get insight for forecasting or business decision in the future.

End-to-end ETL pipeline python

Deterministic SQL formatter CLI in Rust for ANSI SQL and Dremio, built for CI, pre-commit, and editor workflows.

A Dremio ARP connector that supports Hive JDBC behind a knox gateway

Dremio docker-compose using official Docker image. Implemented update/upgrade process allowing to execute dremio-admin upgrade

We will create a sample lakehouse using Docker, execute an ETL process with Spark, and then access the data in the Iceberg table format from the Nessie Catalog.

dremio-oceanbase-learning

Golang SQL driver for Dremio

SQLAlchemy for Dremio via the ODBC and Flight interface.

This pipeline is a mini-project to get comfy with MinIO, Iceburg, Dremio and Nessie, Spark and superset.

An AI-powered Lakehouse platform with Sales Copilot features, enabling smart retail analytics from ingestion to insight.

Dremio with ansible

Complete open-source data platform with Airbyte, Dremio, dbt, and Apache Superset - Documented in 18 languages