Apache Hadoop

Open-source universal artifact registry. Drop-in Artifactory/Nexus alternative with 40+ package formats, security scanning, WASM plugins, and edge replication.

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr…

Apache Spark - A unified analytics engine for large-scale data processing

Apache Arrow DataFusion Comet Spark Accelerator

A high-throughput and memory-efficient inference and serving engine for LLMs

A Pulp plugin to support Python packages

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

Mirror of Apache Knox

C++ based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)

Add PKCS#12 support to the Python requests library in a clean way, without monkey patching or temporary files

A cluster computing framework for processing large-scale geospatial data

A native Rust library for Delta Lake, with bindings into Python

A native Delta implementation for integration with any query engine

Rust object_store crate

🐘 Elasticsearch real-time search and analytics natively integrated with Hadoop

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

Free and Open Source, Distributed, RESTful Search Engine

Apache DataFusion SQL Query Engine

A feature flipper for Django

A safe MIT licensed binding to gssapi

Rust build system integration for libkrb5, MIT's Kerberos implementation

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.