Playground for learning spark

A Twitter Stream Processing Pipeline with ingestion, processing, storage, and visualization.

Play/Spark sample application

Contains the code and examples for my article on Medium, which provides a guide to setting up and running Spark projects using Scala and sbt.

Replicates an Insider Attack on a graph using distributed computing

Alternating Least Squares Music Recommender

A movie recommendation system built using Apache Spark and Scala.

Simple Kafka SparkStreaming example app

Yelp Image Classification Model

Utility for common use cases and bug workarounds in Apache Spark 2

Hands On Apache Spark

The RandNE (Graph embedding) algorithm implemented in Apache Spark

Learning Apache Spark

This project implements a distributed pipeline for NLP model training using Apache Spark and DeepLearning4J (DL4J). The methodology utilizes a sliding window approach for data preparation, positional embeddings for token encoding, and Word2Vec model training with parallel processing. The model and training process is designed for scalability and op