Big data training material

Usage of different Big Data apps

O objetivo desses projetos é ter uma noção geral de como algumas ferramentas que integram o ecossistema Hadoop funcionam

Big Data – Apache server logs analysis using Pig and Python

Análisis al Proyecto GDELT con herramientas bigdata basadas den hadoop en nube Microsoft Azure

Kill pigs and make fun of em.

Reminders, tips and tricks for commands/code running on hadoop cluster (HortonWorks HDP sandbox)

This repo is aimed at working on the grouplens data to solve simple problems using the different applications in the Hadoop Ecosystem.

Pota

A web interface that requests data from search engine and displays results with AmMap.

Big data technologies that I have experimented with

Analysing posts from Stack Exchange on GCP clusters.

Analyze NCDC weather records to compute sky ceiling height range and average visibility distance, aggregating data by USAF weather station ID using Hadoop, PySpark, Pig, and Hive.

Processing and transforming data via Hadoop Ecosystem

Joining, Cleaning, Querying, Performing ETL on Twitter Posts Dataset.

StackExchange data procured is cleaned with pig, queried with hive-ql, performed tf-idf to obtain top 10 words used by top 10 users of StackExchange.

🐘 The Ultimate Hands-On Hadoop - Tame your Big Data!

Working on a batch analytics pipeline using Hortonworks HDP 2.6.5. Include loading data into HDFS, creating schemas, using Pig and Hive for transformations, running a MapReduce job, and building PySpark models for clustering, classification, and regression. NLP and sentiment analysis, reduce features using PCA or SVD, and graph analysis applied.

Scalable Pig Docker image with built-in Hadoop works at Docker Compose and Kubernetes