aws-glue

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

(Unofficial) curated list of awesome workshops found around in the internet. As we all have been there, finding that workshop that you have just attended shouldn't be hard. The idea is to provide an easy central repository, in a collaborative way.

Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub

The Open source Resource as Code framework for Apache Kafka. Jikkou helps you implement GitOps for Kafka at scale!

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.

Data Lake as Code, featuring ChEMBL and OpenTargets

Glue scripts for converting AWS Service Logs for use in Athena

Automated data quality suggestions and analysis with Deequ on AWS Glue

Open innovation with 60 minute cloud experiments on AWS

Streamlit EDA Dashboard Powered by AWS Cloud

⛳️ PASS: Amazon Web Services Certified (AWS Certified) Machine Learning Specialty (MLS-C01) by learning based on our Questions & Answers (Q&A) Practice Tests Exams.

Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects

Learn how to use Kinesis Firehose, AWS Glue, S3, and Amazon Athena by streaming and analyzing reddit comments in realtime. 100-200 level tutorial.

Bring your own data Labs: Build a serverless data pipeline based on your own data

Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS

Terraform modules for provisioning and managing AWS Glue resources

Use the AWS Glue Schema Registry in Python projects.

🌉 Reference implementation for granting cross-account AWS Glue Data Catalog access from Amazon Athena

Example of AWS Glue Jobs and workflow deployment with terraform in monorepo style. Code here supports the miniseries of articles about AWS Glue and python.

Sample code to collect Apache Iceberg metrics for table monitoring