• Built an event-driven data pipeline by using AWS S3 and Lamda that automated how we handle incoming CSV files, which cuts out more hours of manual processing every week and saved on cloud costs by using serverless architecture.
• Engineered ETL functions to make clean and transform hundreds of files per hour as they arrive, this makes sure the data was always structured correctly and which can be ready for analytics team to use without delay.
• Developed a custom monitoring and error-handling system using CloudWatch to ensure zero data loss, so in case a file fails to process, this makes system automatically flag it for a faster fix it impacted to our reports