💁♀️✨ I'm an Associate Data Engineer at Metyis, building smart, scalable, and cloud-native data pipelines for a global client.
🌐 Turning raw data into insights using:
💙 Azure (Functions, Data Lake, Blob Storage)
🐍 PySpark for large-scale batch and stream processing
⚙️ Apache Spark, Flink, Beam for distributed computing
📊 Power BI dashboards for data storytelling
⏱ Working with both:
- ⚡ Real-time data processing (Spark Structured Streaming, Flink, Beam)
- 🧱 Batch workflows for data aggregation, modeling, and reporting
🧰 Also familiar with:
- 🐳 Docker for isolated and portable environments
- ⛓️ Apache Airflow for orchestration and scheduling
- 📂 Parquet, Delta Lake for optimized storage
- 🔁 REST APIs, webhooks & automation workflows
- 🚀 CI/CD pipelines for smooth and fast deployments
🔬 Cloud architecture & cost-efficient design
📐 Advanced data modeling & orchestration strategies
📈 Data reliability, observability, and product-driven metrics
I love making data pipelines that work like magic ✨