I built an AI‑powered Data Analytics SaaS that replaces core responsibilities of a Data Analyst. It uses open‑source LLMs to interpret natural language queries and automatically perform descriptive…

Large-Scale Data Pipeline Migration from Mainframe to Hadoop | Hadoop | Spark | Hive | Sqoop | Oozie | MySQL Migrated a legacy mainframe data warehouse to a modern Hadoop-based big data ecosystem, …

Implementing PostgresSQL best practices for Data Engineer

Implementing best practices for PySpark ETL jobs and applications.

Pandas, Polars, and Spark DataFrame comparison for humans and more!

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

Implementing best practices for PySpark ETL jobs and applications.

A curated list of awesome Apache Spark packages and resources.

A curated list of awesome Apache Spark packages and resources.

Cookbook to install Hadoop 2.0+ using Chef

The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Cente…

PySpark-Tutorial provides basic algorithms using PySpark

Pyspark RDD, DataFrame and Dataset Examples in Python language

Pyspark RDD, DataFrame and Dataset Examples in Python language