A data engineering portfolio project using AWS cloud services to analyze correlations between Malaysian retail performance and fuel prices. Features Terraform IaC, ETL/ELT with AWS S3, Glue, SQL analytics via Athena coupled with data transformation via dbt, and workflow orchestration with Kestra.

Python tools and APIs for working with AWS

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

Funnel is a toolkit for distributed task execution via a simple, standard API.

Test AWS Batch workloads locally without an AWS account

Comparing strategies for dealing with data imbalance in credit risk assessment

Minimal, cloud-agnostic tool runtime for OmniBioAI Tool Execution Service (TES). Provides a strict container execution contract for AWS Batch, Azure Batch, and Kubernetes, enabling reproducible tool execution and standardized results handling across cloud backends.

⛳️ PASS: Amazon Web Services Certified (AWS Certified) Machine Learning Specialty (MLS-C01) by learning based on our Questions & Answers (Q&A) Practice Tests Exams.

This project deploys an AWS Batch infrastructure for Quant Research.

A repository to generate automated backups for the Neotoma PostgreSQL database using AWS infrastructure

batcha is a deployment tool for AWS Batch

A tool that generates comprehensive and in-depth reviews of AI/ML research papers using generative AI technology. Check out my tech blog: https://bits-bytes-nn.github.io/

Tech Digest is a fully automated newsletter service that leverages AI to curate, summarize, and deliver weekly digests of top AI/ML tech blog content to subscribers, eliminating the need for manual content processing and distribution.

🎵 Generate professional AI music videos in the cloud with NVIDIA GPUs and AWS Bedrock. Transform text prompts into complete videos with AI-generated music, lofi-style cover art, and automatic composition.

Amazon Web Services Operator Interface

Multi-codec video encoding pipeline with 4-tier strategy (AV1/VP9/H.264), HLS/DASH streaming, ABR ladder, and AWS Batch integration

This project is an example of using AWS Step functions to manage and track a series of AWS Batch jobs in N_TO_N mode.

Nextflow, WDL and other bioinformatics pipelines for testing our pipeline monitoring platform

Terraform module to create AWS Batch resources 🇺🇦

A {crew} launcher plugin for AWS Batch