SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

A native go client for HDFS

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Go Interface to the TileDB storage manager

Kubernetes 原生的数据交付平台

[G|HD]FS inspired simple distributed filesystem

data transportation tool, from one to another.such as,file, kafka, hdfs etc.

kubectl-nine is a kubectl plugin to manage the NineInfra and the NineClusters on the k8s.

Fast HDFS CLI

Distributed file system based on GFS paper

WebDAV interface to HDFS

Apache Hadoop HDFS operator for the Kubedoop

Go program to copy/sync directory recursively from HDFS server to local storage.

a configuration option helper for hadoop. fuzzy find what you are looking for.

Modular Search Engine Horizontally scalable.

A kubernetes operator for the Apache HDFS

A full-fledged distributed system built from scratch in Go, featuring a distributed log querier, gossip-based failure detection and membership protocol, and a hybrid Cassandra–HDFS file store for scalable, fault-tolerant storage.

RainStorm is a distributed stream processing system built on top of a hybrid distributed file system (HyDFS). Inspired by Apache Spark, Apache Flink, and HDFS/Cassandra design principles, RainStorm provides fault-tolerant, scalable stream processing with exactly-once semantics. The implementation is in Go and is intended to run across multiple VMs.

copy data between hdfs clusters blazingly fast