This project focuses on analyzing patterns (2-hop paths and Triangles) in a Twitter graph dataset containing nodes and edges using Hadoop Spark and various combining and join techniques.

Spark cluster deployment on a k8s cluster

This repository contains makescript and instruction on how to setup local hdfs+spark+hive setup.

Hadoop beginner exercise in analyzing European football teams' statistics over the last 20 years. The goal is to determine which team had the highest win percentage-rate.

A sandbox for running a Hadoop-YARN cluster on Kubernetes

This repository contains makescript and instruction on how to setup local hdfs+spark+hive setup.

Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White