Apache Arrow DataFusion and Ballista query engines

A native Rust library for Delta Lake, with bindings into Python and Ruby.

A native Delta implementation for integration with any query engine

Official Rust implementation of Apache Arrow

Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for effic…

Apache Spark Connect for Rust

Databricks's Zerobus Ingest SDK in Rust

A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate

Rust bindings for the Python interpreter

Apache DataFusion Python Bindings

Apache Spark Connect Client for Rust

A high-performance observability data pipeline.

Delta Acceptance Testing

Template for DuckDB extensions to help you develop, test and deploy a custom extension

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.

Extensible SQL Lexer and Parser for Rust

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust

XML data source for Spark SQL and DataFrames

Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of …