Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Curate better data for LLMs

A Data Streaming Library for Efficient Neural Network Training

The Stockfish testing framework

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.

The open source developer platform to build AI agents and models with confidence. Enhance your AI applications with end-to-end tracking, observability, and evaluations, all in one integrated platform.

XML data source for Spark SQL and DataFrames

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Code to accompany Advanced Analytics with Spark from O'Reilly Media

ZXing ("Zebra Crossing") barcode scanning library for Java, Android