A collection of lambda functions to collect data from Cloudwatch, Kinesis, VPC Flow logs, S3, security-hub and AWS Inspector

Learn how to use Kinesis Firehose, AWS Glue, S3, and Amazon Athena by streaming and analyzing reddit comments in realtime. 100-200 level tutorial.

Typical use cases of opensearch serverelss: search, time-series, kinesis firehose integration, securing with VPC

This web analytics demo shows how to collect web logs with API Gateway and store them into S3 through Amazon Kinesis. Then this project shows how to analyze web logs with Amazon Athena.

This project shows how to implement a simple SaaS metering system on AWS

Amazon Kinesis Firehose logging handler and utilities

This is a project which demonstrates creation of a data pipeline by scraping data using twitter API and creating a data delivery stream using Kinesis Firehose for ingesting data to Amazon S3.

Amazon Kinesis is a tool used for working with data in streams. It has a few features — Kinesis Firehose, Kinesis Analytics and Kinesis Streams and we will focus on creating and using a Kinesis firehose

Keywords: Python, AWS Kinesis, AWS Firehose, AWS Lambda, Snowflake, AWS S3, AWS Athena

Serverless big data streaming application using a fan-out architecture with Lambda and SQS to fetch data from Reddit forums, stream to Kinesis Firehose and store in an S3 data lake.

Singer target for Amazon Kinesis and Kinesis Firehose

An end-to-end AWS data engineering pipeline that orchestrates data ingestion, processing, and storage using Kinesis, S3, Redshift, Lambda, DynamoDB

Backup your twitter account on a daily basis

Streaming analytics using Kinesis Data Analytics using SQL

AWS Kinesis Data Firehose logging handler for Python

AWS based tool to analyse the spread of misinformation on Twitter.

Exciting AWS project that combines a streamlined pipeline for near real-time updates. The architecture is powered by essential AWS services like IAM, VPC, RDS, DMS, Kinesis, S3, and Redshift

A streaming data pipeline leveraging managed services from AWS & the serverless architecture

Streaming data analysis using AWS tools such as Cloud9 to generate events in the cloud, using boto3 to send records to Kinesis Data Firehose to connect to the S3 bucket destination, saving files in .parquet format. With the help of Glue, a data catalog will be created to enable real-time querying of all records with Athena.