MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replica…

Analyzes resource usage and performance characteristics of running containers.

Fast key-value DB in Go.

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

P2P Docker registry capable of distributing TBs of data in seconds

Data-Centric Pipelines and Data Versioning

This repository has be archived and moved to the new repository https://github.com/dragonflyoss/Dragonfly2.

Ignite a Firecracker microVM

Delivers efficient, stable, and secure data distribution and acceleration powered by P2P technology, with an optional content‑addressable filesystem that accelerates OCI container launch.

Measure Amazon S3's performance from any location.

S3 benchmarking tool

Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elastic quotas - Effortless optimization at its finest!

Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch and MindSpore.

InfiniCache: A cost-effective memory cache that is built atop ephemeral serverless functions (USENIX FAST'20)

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.

RobinHood the first tail latency-aware caching system