implementation of partitioning mechanism on Apache Kafka and asynchronous communication between Vert.x microservices

BBoxDB is a scalable, highly available, and distributed data store for multi-dimensional big data. The software supports operations like multi-dimensional range queries and spatial joins. In addition, data streams are supported.

Spring batch common components for partitioned jobs

Spring batch job as Spring Rest service

Spring batch job as Spring cloud task

The content of this repository is part of my thesis submission (computer science degree).

MapReduce, Spark, Java, and Scala for Data Algorithms Book

Custom AEMO MMS Data Model CSV reader for Apache Spark

message queue and broker system similar to Kafka or RabbitMQ.

Java Utilities

Implemented a Kafka-design distributed system by designing publisher, consumer and broker.

Kafka Workers is a client library which unifies records consuming from Kafka and processing them by user-defined WorkerTasks.

Spring data jpa application made to work with partitioned postgres tables

In this project i have implemented the hadoop pipeline using sqoop for ingestion,hive for sumaarising and implementing the warehosue logics and MYSQL as an DB for validationa and storage.The entire thing was automated using the script and with help of bash commands we made it each and every incident is logged properly

How many different ways can you find to calculate the sum of an array by multi-threading? Thread, Runnable, Callable, Future, ExecutorService

Simulation for memory management algorithms (First-fit, Best-fit, Worst-Fit)

PostgreSQL Partitions

Amazon Dynamo-style distributed key-value storage with partitioning, replication, and failure handling

A partitioning algorithm for OWL