-
arrow
Apache Arrow
-
arrow-select
Selection kernels for arrow arrays
-
arrow-schema
Defines the logical types for arrow arrays
-
datafusion
in-memory query engine that uses Apache Arrow as the memory model
-
polars
DataFrame library based on Apache Arrow
-
arrow-cast
Cast kernel and utilities for Apache Arrow
-
duckdb
Ergonomic wrapper for DuckDB
-
chrono-humanize
Human-friendly time expressions - similar to Python arrow.humanize
-
vortex
file format with all builtin codecs and a sampling compressor
-
arrow-ipc
Support for the Arrow IPC format
-
arrow-buffer
Buffer abstractions for Apache Arrow
-
adbc_core
Public abstract API of ADBC
-
edgefirst-cli
EdgeFirst Client Library and CLI
-
arrow-arith
Arrow arithmetic kernels
-
arrow_convert
Convert between nested rust types and Arrow with arrow
-
s2protocol
A parser for Starcraft II - Replay format, exports to different target formats
-
arrow-data
Array data abstractions for Apache Arrow
-
arrow-ord
Ordering kernels for arrow arrays
-
arrow-string
String kernels for arrow arrays
-
datafusion-ffi
Foreign Function Interface implementation for DataFusion
-
narrow
Apache Arrow
-
adbc_driver_manager
ADBC driver manager
-
adbc_snowflake
Snowflake Arrow Database Connectivity (ADBC) driver
-
arrow-udf
User-defined function framework for arrow-rs
-
sedona-geometry
Apache SedonaDB Rust API
-
parquet-variant
Apache Parquet Variant implementation in Rust
-
fastexcel
A fast excel reader for Rust and Python
-
parquet-variant-compute
Apache Parquet Variant Batch Processing
-
sedona-spatial-join
Apache SedonaDB Rust API
-
adbc_ffi
ADBC FFI and driver exporter
-
hdbconnect-arrow
Apache Arrow integration for hdbconnect SAP HANA driver
-
sedona-functions
Apache SedonaDB Rust API
-
sedona-geos
Apache SedonaDB Rust API
-
polars-arrow
Minimal implementation of the Arrow specification forked from arrow2
-
hyperdb-api
Pure Rust API for Hyper database
-
datafusion-physical-expr
Physical expression implementation for DataFusion query engine
-
parquet-variant-json
Apache Parquet Variant to/from JSON
-
parquet-geospatial
Apache Parquet Geometry and Geography implementation in Rust
-
hyperdb-mcp
MCP server for Hyper database — instant SQL analytics for LLM workflows
-
sedona-raster
Apache SedonaDB Rust API
-
sedona
Apache SedonaDB Rust API
-
polars-io
IO related logic for the Polars DataFrame library
-
sedona-geo
Apache SedonaDB Rust API
-
polars-parquet
Apache Parquet I/O operations for Polars
-
sedona-expr
Apache SedonaDB Rust API
-
sedona-raster-functions
Apache SedonaDB Rust API
-
arrow-row
Arrow row format
-
vortex-layout
Vortex layouts provide a way to perform lazy push-down scans over abstract storage
-
sedona-schema
Apache SedonaDB Rust API
-
vortex-sparse
Vortex Sparse array
-
vortex-io
Core async and blocking IO traits and implementations, used by IPC and file format
-
vortex-runend
Vortex run end encoded array
-
vortex-alp
Vortex ALP array
-
vortex-mask
Vortex Mask - sorted, unique, non-negative integers
-
datafusion-odata
OData protocol adapter for Apache Datafusion
-
polars-ffi
FFI utils for the Polars project
-
ambers
Pure Rust reader for SPSS .sav and .zsav files
-
sea-orm-arrow
Arrow integration for SeaORM
-
sedona-testing
Apache SedonaDB Rust API
-
ballista-scheduler
Ballista Distributed Compute - Scheduler
-
sedona-s2geography
Apache SedonaDB Rust API
-
vortex-error
Vortex errors
-
sedona-proj
Apache SedonaDB Rust API
-
sedona-geoparquet
Apache SedonaDB Rust API
-
sedona-datasource
Apache SedonaDB Rust API
-
lightstream
Composable, zero-copy Arrow IPC and native data streaming for Rust with SIMD-aligned I/O, async support, and memory-mapping
-
datafusion-execution
Execution configuration support for DataFusion query engine
-
polars-stream
Private crate for the streaming execution engine for the Polars DataFrame library
-
re_arrow_util
Helpers for working with arrow
-
datafusion-proto-common
Protobuf serialization of DataFusion common types
-
pq-parquet
The jq of Parquet. Inspect, transform, and operate on Parquet files from your terminal. S3, GCS, Azure support. CLI tool.
-
vortex-bytebool
Vortex byte-boolean array
-
arrow_extendr
Enables the use of arrow-rs in R using extendr and nanoarrow
-
cityjson-parquet
Parquet read/write for CityJSON 2.0 city models via cityjson-arrow
-
sedona-geo-generic-alg
Apache SedonaDB Rust API
-
greptimedb-ingester
client for GreptimeDB gRPC protocol
-
cityjson-arrow
Arrow IPC and Parquet transport for CityJSON 2.0 city models
-
otlp2records
Transform OTLP telemetry to flattened records
-
sedona-tg
Apache SedonaDB Rust API
-
datafusion-dft
An opinionated and batteries included DataFusion implementation
-
nu_plugin_bigquery
A Nushell plugin for querying Google BigQuery
-
vortex-utils
Common definitions across crates
-
sedona-adbc
Apache SedonaDB Rust API
-
sedona-geo-traits-ext
Apache SedonaDB Rust API
-
datafusion-common-runtime
Common Runtime functionality for DataFusion query engine
-
marrow
Minimalist Arrow interop
-
vortex-sequence
Vortex run end encoded array
-
vortex-zstd
Vortex zstd compression array encoding
-
wp-core-connectors
Core connector registry and sink runtimes for WarpParse
-
vortex-metrics
Vortex Metrics
-
vortex-pco
Vortex Pco array
-
sedona-geoarrow-c
Apache SedonaDB Rust API
-
qvd
High-performance library for reading, writing and converting Qlik QVD files with Parquet/Arrow/DataFusion support
-
vortex-session
Session object for Vortex
-
adbc_clickhouse
Official ClickHouse ADBC driver
-
vortex-dtype
Vortex's core type system
-
nusy-kanban
Arrow-native kanban engine — SHACL shapes, graph-native PRs, dual boards, NATS multi-agent collaboration
-
adbc_datafusion
ADBC driver for Apache DataFusion
-
avila-arrow
Zero-copy columnar format with scientific arrays (Quaternions, Complex, Tensors, Spinors), SIMD acceleration (35x), and native compression (125x RLE, 16x BitPack, 4x Delta) - Zero external dependencies
-
geo-soft-rs
Parser for NCBI GEO SOFT format → Arrow RecordBatches
-
clickhouse-datafusion
High-performance ClickHouse integration for Apache DataFusion with federation support
-
firn
snowflake-rs fork: cancellation, async, streaming, multi-statement, bind params, structured types, retry middleware
-
nusy-arrow-git
Graph-native git on Arrow RecordBatches — commit, checkout, merge, diff, blame, rebase, cherry-pick, revert
-
vortex-decimal-byte-parts
Vortex decimal array (non-canonical) encodings
-
cudf
Safe Rust bindings for NVIDIA libcudf -- GPU-accelerated DataFrame operations
-
znippy
compresses files using Arrow IPC. Readable by DuckDB,Polars,Datafusion. May Allfather Odin watch over every bit.
-
exon
A platform for scientific data processing and analysis
-
hudi
The native Rust implementation for Apache Hudi
-
elasticube-core
High-performance embeddable OLAP cube library built on Apache Arrow and DataFusion, with support for dynamic aggregations, calculated fields, and incremental updates
-
vortex-tensor
Vortex tensor extension type
-
sedona-pointcloud
Apache SedonaDB Rust API
-
vortex-compressor
Encoding-agnostic compression framework for Vortex arrays
-
apexbase
High-performance HTAP embedded database with Rust core
-
ptars
Fast conversion from protobuf to Apache Arrow and back
-
formualizer
Embeddable spreadsheet engine — parse, evaluate & mutate Excel workbooks from Rust
-
obs-parquet
Single-table Parquet/Arrow analytics sink for the obs SDK
-
transcriptomic-rs
Expression matrix assembly and normalization → Arrow RecordBatches
-
re_chunk_store
A storage engine for Rerun's Chunks
-
nanograph
Embedded typed property graph database. Schema-as-code, compile-time validated, Arrow-native.
-
exon-bigwig
Subcrate of the
exoncrate for working with BigWig files -
nisaba
Data quality, reconciliation, and validation across different data stores
-
df-interchange
Seamless interoperability between Polars and Arrow
-
pq-fabric
CLI for executing Power Query M expressions via the Microsoft Fabric API; preview partitions, test transformations, inspect steps
-
arrow-pyarrow
Pyarrow bindings
-
aisle
Metadata-driven Parquet pruning for Rust: Skip irrelevant data before reading
-
timeseries-table-core
Core engine for a Rust-native log-structured time-series table format (metadata log + coverage bitmaps)
-
myval
Lightweight Apache Arrow data frame
-
tiders-x402-server
Payment-enabled database API server that connects different databases with the x402 payment protocol to create a pay-per-query data marketplace
-
nusy-graph-query
Graph-native semantic search for Arrow RecordBatches — embeddings, traversal, hybrid ranking, and caching
-
polars-compute
Private compute kernels for the Polars DataFrame library
-
avx-arrow
Zero-copy columnar format with scientific arrays (Quaternions, Complex, Tensors, Spinors), SIMD acceleration (35x), and native compression (125x RLE, 16x BitPack, 4x Delta) - Zero external dependencies
-
polars-json
JSON related logic for the Polars DataFrame library
-
seonbi
Korean text arrow/quote/punctuation processor
-
athena-udf
building AWS Athena User Defined Functions in Rust
-
xlog-core
Core types, traits, and error surfaces shared across XLOG
-
datafusion-materialized-views
Materialized Views & Query Rewriting in DataFusion
-
pyo3-geoarrow
GeoArrow integration for pyo3
-
evolution
Efficiently evolve your old fixed-length data files into modern file formats
-
sedona-common
Apache SedonaDB Rust API
-
oxigdal-geoparquet
GeoParquet driver for OxiGDAL - Pure Rust GDAL reimplementation
-
arrow-format
Unofficial flatbuffers and tonic code of Apache Arrow spec
-
vortex-cuda-macros
Proc macros for CUDA conditional compilation in Vortex
-
arrow-udf-runtime
Runtime for Arrow UDFs
-
convergence
Write servers that speak PostgreSQL's wire protocol
-
simd-kernels
Lightning Fast, Arrow-Compatible Compute Kernels
-
exon-vcf
Exon VCF
-
re_sorbet
Rerun arrow metadata definitions
-
parquet-lite
A lightweight, pure-Rust alternative to the official Apache Parquet crate — minimal dependencies, small binary size, WASM-compatible
-
polarway-lakehouse
Delta Lake storage layer for Polarway — ACID transactions, time-travel, audit logging, and user management
-
pyspark-arrow-rs
Derive macros to be used to add some helper functions to Rust structs to make them useable in Pyspark's mapInArrow
-
arcon
A runtime for writing streaming applications
-
flarrow-api
flarrow (flow + arrow) is a rust runtime/framework for building dataflow applications
-
arrow-tools
packages
-
clinical-tasks
Clinical prediction task windowing — Arrow event streams to ML-ready datasets
-
tenrso-ooc
Out-of-core processing with Arrow/Parquet for TenRSo
-
vgi-rpc-s3
S3-backed ExternalStorage for vgi-rpc (pluggable pre-signed URL factory + reqwest transfer)
-
parquet-key-management
Implements the Parquet Key Management Tools API in Rust to enable integration with a Key Management Server when using Parquet modular encryption
-
live-data
Shared descriptor, manifest, and subscription types for the live-feed publisher SDK and the live-stream consumer SDK
-
fletch
High-throughput, data logger for test engineering and HIL platforms
-
exon-bam
Exon BAM
-
arrow-graph-core
Arrow-native graph store with configurable namespace partitioning and optional layer columns
-
rhei-flight
Arrow Flight SQL server for Rhei HTAP engine OLAP queries
-
re_arrow_ui
Show arrow data in a tree of rerun list_items and format arrow with syntax highlighting
-
live-binance
Binance public market data WebSocket streams. Plugs into the live-feed publisher SDK; data flow goes via lightstream's WebSocket-JSON pipeline.
-
exon-bed
Subcrate of the
exoncrate for working with BED files -
term-guard
data validation library providing Deequ-like capabilities without Spark dependencies
-
llkv-sql-pong-demo
Watch a terminal play pong against itself using the LLKV SQL engine in a game loop. Mainly for perf evaluation.
-
exon-sdf
Exon SDF
-
llkv-table
Columnar table using the LLKV toolkit
-
polars-dtype
Low-level datatype definitions of the Polars project
-
vgi-rpc-gcs
GCS-backed ExternalStorage for vgi-rpc (pluggable V4 signed URL factory)
-
polars-python
Enable running Polars workloads in Python
-
exon-fastq
FASTQ support for Exon
-
llkv-executor
Query execution engine for the LLKV toolkit
-
mqd-engine
Async ingest, snapshot-isolated store, point-in-time query, and domain operators over Arrow
-
llkv-aggregate
Aggregate computation engine for the LLKV toolkit
-
arrow-graph-git
Graph-native git primitives on Arrow RecordBatches — commit, checkout, merge, diff, blame, rebase
-
data-signals
Parent crate for the live-data ecosystem: protocol types (live-data), publisher SDK (live-feed), consumer SDK (live-stream)
-
pqrs
Apache Parquet command-line tools and utilities
-
live-stream
Consumer SDK for browsing and subscribing to live data feeds. Publishers use the live-feed crate.
-
exon-mzml
Exon MzML
-
arrow-udf-wasm
WebAssembly runtime for Arrow UDFs
-
ptr-arrow
A macro to emulate C-style arrow syntax
-
data-connectors
Parent crate for the live-data ecosystem's connector library. Per-exchange source-spec crates for popular live data feeds.
-
fuse-rule
High-performance, Arrow-native Complex Event Processing (CEP) engine with SQL-powered rules
-
adbc-taos
A high-performance Rust driver for TDengine time-series database, implementing the ADBC standard
-
arrow-kafka
Rust-based high-performance Kafka sink with Arrow zero-copy support
-
exon-io
IO utilities for Exon
-
qdrant-datafusion
Qdrant integration for Apache DataFusion
-
datafusion-catalogprovider-glue
Glue as a CatalogProvider for Datafusion
-
alopex-dataframe
Polars-compatible DataFrame API for Alopex DB (v0.1)
-
stately-arrow
Arrow backend utilities for viewing data over API
-
sterunets
Capabilities for processing data with Arrow and Polars
-
re_format_arrow
Format arrow data
-
recutils-rs
Rust FFI bindings to GNU recutils (librec) with an optional Arrow conversion layer
-
hudi-datafusion
The native Rust implementation for Apache Hudi
-
arrow-ml-common
Shared error types and runtime backend plugin registry for arrow-ml
-
minarrow-pyo3
PyO3 bindings for MinArrow - zero-copy Arrow interop with Python via PyArrow
-
exon-common
Common utilities for Exon
-
scivex-io
Scivex — CSV, JSON, SQL, Parquet, and Arrow I/O for DataFrames
-
vortex-gpu-kernels
Vortex GPU kernel generation
-
llkv-join
Table join operators for the LLKV toolkit
-
parx-rs
Parx format Rust library
-
exon-bcf
Exon BCF
-
vgi-rpc-macros
Proc-macros for vgi-rpc: #[service], #[unary], #[producer], #[exchange], #[derive(VgiArrow)], #[derive(StreamState)]
-
flarrow-file-ext
flarrow (flow + arrow) is a rust runtime/framework for building dataflow applications
-
flarrow-url-scheme
flarrow (flow + arrow) is a rust runtime/framework for building dataflow applications
-
flarrow-flows
flarrow (flow + arrow) is a rust runtime/framework for building dataflow applications
-
lutra-arrow
Arrow format conversion for Lutra: converting between Arrow RecordBatch and Lutra binary values
-
exon-fasta
reading and writing FASTA files with Exon
-
exon-gff
reading and writing GFF files with Exon
-
holger-cli
Holger guards your artifacts at rest
-
llkv-sql
SQL interface for the LLKV toolkit
-
jammi-server
Arrow Flight SQL server and health probe for Jammi AI
-
polars-core
Core of the Polars DataFrame library
-
ipfrs-tensorlogic
Zero-copy tensor operations and logic programming for content-addressed storage
-
exon-gtf
GTF datasource for Exon
-
exon-genbank
Exon GenBank
-
warc-parquet
converting WARC to Parquet
-
ttoon-core
Core Rust library for T-TOON / T-JSON typed text serialization and Arrow conversion
-
yaxp-common
<yaxp-cli ⚡> Yet Another XML Parser
-
exon-fcs
Exon FCS
-
llkv-csv
CSV reader and writer for the LLKV toolkit
-
starfix
Package for hashing Arrow's data structures uniquely for identifying and comparing data efficiently
-
n3gb-rs
hierarchical hex-based spatial indexing system based on the OSGB National Grid
-
flarrow-url-default
flarrow (flow + arrow) is a rust runtime/framework for building dataflow applications
-
arrow-udf-flight
Client for remote Arrow UDFs
-
exon-cram
Exon CRAM
-
liquid-cache-server
10x lower latency for cloud-native DataFusion
-
arrow-ml-backend-metal
Metal GPU backend plugin for arrow-ml. Discovered at runtime by arrow-ml-common's backend registry.
-
liquid-cache-client
10x lower latency for cloud-native DataFusion
-
amadeus-parquet
An Apache Parquet implementation in Rust
-
liquid-cache-datafusion-server
10x lower latency for cloud-native DataFusion
-
liquid-cache-datafusion-client
10x lower latency for cloud-native DataFusion
-
vineyard-datafusion
Vineyard Rust SDK: arrow datafusion integration for DataFrame
-
supertable-core
Core library for SuperTable, a next-generation open table format
-
polarway-grpc
gRPC server for Polarway Railway-Oriented Data Processing
-
datafusion-data-access
General data access layer currently mainly based on the object store interfaces
-
arrow2_convert
Convert between nested rust types and Arrow with arrow2
-
datafusion-jit
Just In Time (JIT) compilation support for DataFusion query engine
Try searching with DuckDuckGo.