I architect and deliver cloud-native data platforms that move real data at real scale — 5TB/day ETL, 1M IoT events/hour, 5M+ GPS records in production. Currently at GHD (UK), building geospatial and streaming pipelines for global infrastructure clients.

• 5 years designing end-to-end data platforms (ingestion → transformation → orchestration → serving)
• Triple cloud certified — Microsoft Azure · AWS · Google Cloud
• Expertise in real-time streaming (Kafka, Spark Streaming, Delta Lake) and modern data stack (dbt, Snowflake, Airflow, Databricks)
• Open to fully remote roles across US, UK, Australia, and Europe

Cloud

Processing & Streaming

Warehousing & Transformation

Orchestration

Languages

DevOps & IaC

BI & Visualization

End-to-end streaming data platform: Kafka ingestion → PySpark Structured Streaming → Delta Lake → Snowflake → dbt models → Airflow orchestration. Production-grade with CI/CD, data quality checks, and monitoring.
Kafka PySpark Delta Lake Snowflake dbt Airflow Docker GitHub Actions

Medallion architecture (Bronze/Silver/Gold) on Azure Data Lake Storage + Databricks + Delta Lake + ADF. Includes Unity Catalog governance, Great Expectations data quality, and Power BI serving layer.
Azure Databricks Delta Lake ADF dbt Unity Catalog Power BI

Processes 5M+ GPS records for mining fleet operations: haversine distance, raster elevation, DBSCAN clustering for EV station placement, and interactive Leaflet.js stakeholder dashboard.
PySpark Databricks GeoPandas DBSCAN Leaflet.js Delta Lake

• Microsoft Certified: Azure Data Engineer Associate
• AWS Certified Data Engineer
• Google Cloud Professional Data Engineer

GHD — Data Engineer (Remote, UK-based client)
Building geospatial data platforms for global infrastructure and mining clients.

Open to Senior Data Engineer / Data Platform Engineer roles — Remote · US · UK · Australia · Europe
abhishek2f24@gmail.com