Source code for the X Recommendation Algorithm

Apache Spark - A unified analytics engine for large-scale data processing

A fault tolerant, protocol-agnostic RPC system

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

A machine learning package built for humans.

Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules

ZIO — A type-safe, composable library for async and concurrent programming in Scala

A distributed, fault-tolerant graph database

Spark: The Definitive Guide's Code Repository

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

Apache Spark to Apache Cassandra connector

Base classes to use when writing tests with Spark

Protocol buffer compiler for Scala.

Apache DataFusion Comet Spark Accelerator

Livy is an open source REST interface for interacting with Apache Spark from anywhere

Development in Shark has been ended.

TiSpark is built for running Apache Spark on top of TiDB/TiKV

Essential Spark extensions and helper methods ✨😲

A simplified, lightweight ETL Framework based on Apache Spark

Ergo protocol description & reference client implementation

Unified SQL Analytics Engine Based on SparkSQL

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Nebula-Algorithm is a Spark Application based on GraphX, which enables state of art Graph Algorithms to run on top of NebulaGraph and write back results to NebulaGraph.

sql interface for solr cloud

Flink Examples

A Scala implementation of the geohashing algorithm

A library for reading data from Amzon S3 with optimised listing using Amazon SQS using Spark SQL Streaming ( or Structured streaming).

Some AWS EMR examples

Scala utility to send mail

Pub/Sub built on top of FoundationDB