Quix Notebook Manager

Acervo de notebooks referente aos exercícios do curso SQL para Análise de Dados realizado pela EBAC como parte do curso Profissão: Cientista de Dados.

Demonstration of how to run interactive Athena queries using the ODBC driver in a Jupyter Notebook running in Docker

The pipeline integrates multiple data sources web-scraped community areas, taxi trip data from the Chicago Open Data API, and weather data from Open-Meteo. It cleans, normalizes, and merges them with Python, loads the processed results to AWS S3 via Lambda, and provides interactive analysis in Jupyter notebooks.

This project focused on real-time stock market data streaming using Apache Kafka. The project demonstrates how to use Apache Kafka for capturing, processing and streaming stock market data efficiently. It is implemented entirely in Jupyter Notebook and deployed in Amazon EC2 instance and S3; Amazon Athena, Glue and crawler is used to consume data..