apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
See what the GitHub community is most excited about today.
Apache Spark - A unified analytics engine for large-scale data processing
Removes large or troublesome blobs like git-filter-branch does, but faster. And written in Scala
The Community Maintained High Velocity Web Framework For Java and Scala.
A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility
Mill is a fast JVM build tool that supports Java and Scala. 2-3x faster than Gradle and 5-10x faster than Maven for common workflows, Mill aims to make your project’s build process performant, maintainable, and flexible
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
♞ lichess.org: the forever free, adless and open source chess server ♞
Build highly concurrent, distributed, and resilient message-driven applications on the JVM
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
State of the Art Natural Language Processing
Source code for Twitter's Recommendation Algorithm
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
An open protocol for secure data sharing
Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
ZIO — A type-safe, composable library for async and concurrent programming in Scala
The Scala 3 compiler, also known as Dotty.
sbt, the interactive build tool
FEEL parser and interpreter written in Scala
A Scala API for Apache Beam and Google Cloud Dataflow.
workbench identity and access management