HDP related tools

Step By Step guide for Hadoop installation on Ubuntu 16.04.3 with MapReduce example using Streaming

Real Time Streaming: Twitter Data Pipeline Using Big data Tools

Big Data Assignments

A mini-Hadoop clone capable of performing all DFS functionalities through a CLI

Simple python script to convert multiple json files into a parquet or and ORC file to be used on Hadoop.

A PySpark-based pipeline for detecting anomalies in energy consumption using unsupervised models (PCA, Isolation Forest, LOF). The system processes raw JSON data, aggregates monthly features, and identifies anomalous PODIDs using an ensemble approach, ready for production deployment.

Proyecto #3 - Big Data de la materia tópicos especiales de telematica

Scalable Hadoop Docker image that can works on Docker Compose and Kubernetes

we are using python to automate docker , Hadoop ,

This is an analysis on NYC Parking Violations dataset using PySpark SparkSQL and Map Reduce to find some useful insights.

Describes the map-reduce concept used in Data Processing - Data Engineering

Cloud Computing course projects

Movie Analytics in Big Data Using Hadoop and Spark

A data pipeline on GCP Dataproc using Sqoop, HDFS, Hive, and PySpark to implement SCD Type 2 for an e-commerce use case. Tracks customer and product changes (e.g., address, price) and their impact on sales, demonstrating scalable data warehousing and processing.

Repository containing python code for MapReduce jobs to answer questions about Udacity forum data.

This repository contains a python script that can be used to solve multiple use-cases starting from os use cases like creating partitions, LVM, Hadoop tasks, AWS tasks, Docker tasks, etc.

Usage of different Big Data apps