soda-core

Collibra governance tooling — edge stack deployment, contract ID generation, data contract lifecycle, ORM/SBVR semantic pipeline, and API server. All features are exposed through the singine collibra CLI family.

An automated data quality monitoring solution for daily sales pipelines, built on top of the open-source framework Soda Core to execute SQL Server data validation and anomaly detection.

Enterprise Reference Architecture & interactive hands-on lab suite for Data Mesh, Open Data Contracts (ODCS), dbt Model Contracts, Shift-Left Quality Gates, and End-to-End Data Observability.

The standard benchmark for data quality tools — detection, transformation, entity resolution, and pipeline orchestration. 4 categories, 12 tiers, 161 tests.

Production-style YouTube Analytics ELT pipeline with Airflow orchestration, dbt transformations, Soda Core data quality checks, PostgreSQL, and full Docker + GitHub Actions CI/CD.

Production-grade RAG data pipeline: Kafka → Spark Structured Streaming → Delta Lake (Bronze/Silver/Gold) → OpenAI Embeddings → Pinecone. Quality-gated with Soda Core, orchestrated by Airflow, observed with OpenLineage, served via FastAPI.

Month-end close automation for a three-entity, two-currency group that refuses to publish output it cannot vouch for. Ten controls, signed control report, Soda Core checks.

A production-grade Modern Data Stack (MDS) implementation featuring automated ELT, SCD Type 2 history tracking, and CI/CD quality guardrails using Dagster, dbt Core, DuckDB, and Soda.

🍳 Modern Data Platform built with Apache Airflow 3.x, PostgreSQL, and dbt. Modular Domain-Driven Design (DDD) architecture with automated web scraping (Scrapling), Soda data quality checks, statistical ML predictions, and dynamic Grafana monitoring.

Real-time data platform with enforced data contracts— Kafka, Flink, Delta Lake, dbt, Soda Core

Production-grade F1 telemetry pipeline using Medallion Architecture on Databricks

Pipeline de données hybride (Streaming & Batch) automatisant l'attribution de primes RH. Intègre Kafka, Airflow, PostgreSQL et SODA Core pour l'ingestion temps réel, l'orchestration et le contrôle qualité, avec restitution sous Power BI.