An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

Your favorite language gets closer to bare metal.

State of the Art Natural Language Processing

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.

A Scala API for Apache Beam and Google Cloud Dataflow.

Base classes to use when writing tests with Spark

Hybrid search engine, combining best features of text and semantic search worlds

A type-checker for Erlang

A Spark plugin for reading and writing Excel files

Advanced similarity and duplicate source code at scale.