I build data infrastructure in highly complex domains -- upstream O&G, energy markets, and regulatory datasets. Currently contracting in London on AWS-based pipelines (S3, Redshift, Kafka, PostgreSQL).

Previously at Shell Global Solutions, where I led the OSDU Cloud Migration programme -- a migration of upstream technical data from Shell's on-premises Corporate Data Store into the cloud-based Open Subsurface Data Universe (OSDU) platform, across global assets, and owned six workstreams across the programme:

• ETL Pipeline Development (Informatica / OSDU) -- built Informatica Cloud Data Integration (CDI) pipelines to migrate subsurface data from CDS and SDU into OSDU; constructed OSDU-compliant JSON manifests using Hierarchy Builder with full attribute coverage; applied reference data translation to standardise source values across regional variants; extended pipelines with Python scripts including DLIS-to-Parquet conversion via dlisio; handled flat file migration (DLIS, LAS, WITSML) through the OSDU Content Delivery Service; orchestrated and troubleshot pipeline runs via Apache Airflow; validated ingested records using OSDU Search and Storage APIs; versioned Informatica pipeline assets in GitHub; deployed to production via ServiceNow change management; built parameterised multi-region pipelines to eliminate per-asset cloning

• Coathanger -- Migration of foundational / core well data (well names, identifiers, and key attributes) for the Americas, Europe and Africa Assets from Shell's on-premises Corporate Data Store into the cloud-based Open Subsurface Data Universe (OSDU) platform

• Entitlements & Obligations (E&O) -- data governance and access control; played a core role in designing, testing, and implementing the cloud-native DMA (Data Management Application) -- Shell's replacement for the legacy Central Data Register (CDR); performed detailed contractual E&O reviews for core assets and applied a risk-based approach for Lean and Legacy assets; extracted legal attributes from source documents as JSON using Python and created legal tags in DMA; designed ACL group structures governing data access and CRUD permissions; integrated legal tags directly into ETL pipelines for automated assignment during migration; collaborated with Legal, C&P (Contracts and Procurement), and Commercial teams; maintained the single source of truth spreadsheet tracking E&O approval status per asset and data type

• Data Readiness -- designed and codified showstopper and non-showstopper migration eligibility rules in collaboration with the data design team; built readiness dashboards in Power BI against SQL schemas designed to profile EDM and CDS relational data types; wrote Python scripts for non-relational Recall checks; validated data integrity (SUWI/SUWBI alignment across EDM and CDS), reference value consistency, and record uniqueness; produced E&O-approved, readiness-cleared test datasets as inputs for acceptance and production pipeline testing; maintained a global master migration eligibility tracker spanning all data types and assets

• WMM/DS/DMA Mastership Change -- led the mastership transition of three platforms -- Well Master Manager (WMM), Directional Survey (DS), and Data Management Application (DMA) -- from Shell Data Universe (SDU), Shell's proprietary precursor to OSDU, into the standardised cloud-based Open Subsurface Data Universe (OSDU)

• WBDDMS Focus Group (Wellbore Domain Data Management Service) -- led the focus group; designed and implemented a framework to convert single DLIS files to Parquet, introducing Equinor's dlisio library into the programme; presented findings to senior leadership

I hold an MSc in Data Science (RGU), MSc in Integrated Petroleum Geoscience (Aberdeen), and MSc in Petroleum Geophysics (OAU) -- which means I can read a well log, a seismic section, and a Kafka offset in the same morning.

• Streaming pipelines -- Kafka, Spark Structured Streaming, Debezium CDC
• Cloud data infrastructure -- AWS (S3, Redshift, Glue, Lambda), Azure (ADF, Databricks, Fabric)
• Subsurface & geospatial data -- OSDU, DLIS, SEG-Y, WITSML, RESQML
• Analytics & warehousing -- dbt, PostgreSQL, Redshift, data modelling
• Orchestration & containerisation -- Airflow, Docker, Docker Compose

Stream processing -- Agile Energy Price Pipeline Production-grade Kafka + Spark Structured Streaming pipeline ingesting Octopus Agile API data into PostgreSQL, with a Streamlit dashboard. Fully containerised with Docker Compose.

View repo | Portfolio

Most data engineers can move data. Fewer understand what it means when a WITSML log has a mismatch between depth reference frames, or why OSDU entitlement schema matters at the asset level. That gap is where I work.

• Contracting as Data Engineer (AWS stack, London)
• Building toward Microsoft Fabric Data Engineer certification (DP-700)
• Open to senior Data Engineer and Data Analyst roles (visa sponsorship required)

LinkedIn | Portfolio | simon.n.udoh@gmail.com