Friendly CLI for Amazon Kinesis Data Streams

Setup an ETL from Twitter API to S3

Iot,Big Data Analytics using Apache-kafka,spark and other aws services

Sample scripts for Twitter data processing and storage on AWS

Describes the concepts of lambda architecture and the actual deployment process with an example of building a serverless business intelligence systems using Amazon Kinesis, S3, Athena, OpenSearch Service, and QuickSight.

Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark

you run a script to mimic multiple sensors publishing messages on an IoT MQTT topic, with one message published every second. The events get sent to AWS IoT, where an IoT rule is configured. The IoT rule captures all messages and sends them to Firehose. From there, Firehose writes the messages in batches to objects stored in S3. In S3, you set u…

automatic image tagger and image tag analysis

Shipping AWS RDS logs from s3 into a kinesis stream

This sample application demonstrates Amazon SNS with AWS X-Ray active tracing

Python script that produces logs observed by the Amazon Kinesis Agent

A unique sentiment analysis model on IMDB reviews with custom negation handling. Instead of generic preprocessing, it smartly tags words after negators like "not" (e.g., "not good" → "not_good"), preserving sentiment context. Comparison of models with and without this logic shows improved accuracy and real-world reliability.

Utility code for AWS Services. Sample use case could be querying data from KDS. This project is open to receive contribution.

In this project, we build a real-time data pipeline to analyze global market data using AWS Kinesis and Snowflake. The pipeline streams CSV datasets through Kinesis Firehose, processes and transforms the data, and finally visualizes insights using Power BI.

Autonomous Byzantine-resilient V2G energy arbitrage system. BFT sensor filtering, probabilistic forecasting, LP dispatch, and physics-based grid validation on real ENTSO-E data.

Real-time Twitter sentiment analysis using AWS services. Captures tweets, analyzes sentiment with Comprehend, and stores results in DynamoDB for visualization and insights into trends.

Big Data Lab | Stream Delivery AWS Kinesis Firehose

A streaming data pipeline leveraging managed services from AWS & the serverless architecture

An intelligent, real-time fraud detection platform built with a hybrid architecture of rule-based logic, generative AI, and streaming data pipelines. It monitors transaction streams, detects anomalies, explains them in natural language, and logs insights for analytics.

🚀 Analyze big data effortlessly with PySpark through modular pipelines for batch processing, graph analytics, and real-time streaming insights.