Open Source Linux File Systems

Collectl is a light-weight performance monitoring tool capable of reporting interactively as well as logging to disk. It reports statistics on cpu, disk, infiniband, lustre, memory, network, nfs, process, quadrics, slabs and more in easy to read format.

UNFS3 is a user-space implementation of the NFSv3 server specification. It provides a unified mountd and nfsd program and so far runs under Linux, NetBSD, and Solaris.

MooseFS (MFS) is a fault tolerant, highly performing, scaling-out, network distributed file system. It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS mounted with FUSE acts as other Unix-alike file systems: * A hierarchical structure (directory tree) * Stores POSIX file attributes (permissions, last access and modification times) Supports special files (block and character devices, pipes and sockets) * Symbolic links (file names pointing to target files, not necessarily on MooseFS) and hard links (different names of files which refer to the same data on MooseFS) * Access to the file system can be limited based on IP address and/or password MooseFS on GitHub: https://github.com/moosefs/moosefs Packages repository, download: https://moosefs.com/download Documentation: https://moosefs.com/support Recent changes: https://github.com/moosefs/moosefs/blob/master/NEWS

ClusterNFS allows diskless clients to share a single root filesystem by matching "interpreted" file names of the form "/path/filename$$KEY=value$$" with fallback to the original filename. Keys include HOSTNAME, IP, UID, GID, and CLIENT (always matches

The OpenSSI project is a comprehensive clustering solution offering a full, highly available SSI environment for Linux. Goals for OpenSSI Clusters include availability, scalability and manageability, built from standard servers.

THE REPOSITORIES AT SourceForge ARE OUT OF DATE. DO NOT USE. Download pages, repositories, tickets and wiki have been moved to https://github.com/oss-tsukuba/ Download: gfarm: https://github.com/oss-tsukuba/gfarm/releases gfarm2fs: https://github.com/oss-tsukuba/gfarm2fs/releases and more: https://github.com/oss-tsukuba/gfarm/wiki#download Repositories: gfarm: https://github.com/oss-tsukuba/gfarm gfarm2fs: https://github.com/oss-tsukuba/gfarm2fs and more: https://github.com/orgs/oss-tsukuba/repositories Tickets: gfarm: https://github.com/oss-tsukuba/gfarm/issues gfarm2fs: https://github.com/oss-tsukuba/gfarm2fs/issues Wiki: https://github.com/oss-tsukuba/gfarm/wiki Gfarm file system is a network shared file system that supports scalable I/O performance in distributed environment. It can federate local disks of network-connected PCs and compute nodes in several clusters.

The Linux InfiniBand Project is a collection of sub-projects focused around providing InfiniBand drivers for existing 2.4 based kernels. See Home Page for details.

This is a distribute file system that like gfs or ndfs in c++

InterMezzo is a high availability file system with disconnected operation and persistent caching. It exploits existing Linux file systems as the cache and has protocols similar to Coda.

The NFS/RDMA project is a reference implementation of a new RDMA-capable ONC RPC transport for use by Linux kernel NFS. This transport implementation is now available as part of the Linux kernel. The code is also available separately under a dual GPL/BSD

Client and server implementations of the 9P and 9P2000 distributed resource protocols for Unix-based operating systems. See project home page for up-to-date news and source release information.

A peer-to-peer file replication (synchronization) engine written in Java. Managed via the web. Keywords: RMI, JSP, Sync, P2P.

PyGFS is a reliable and secure distributed file system that runs completely in userspace. It supports x509 certificate authentication, authorization and encryption mechanisms to provide secure access over insecure networks.

Unix/Corba tools for distributed, scalable file storage. This is a school projet, we don't really need developers ...

Command line tools designed to setup and manage the Lustre file system on a cluster.

64-Bit journaled filesystem for Linux and Windows 2000, supporting ACLs, Named Streams, directory indexing, and Unicode.

ZFS is a system of automatically replicating file servers closely resembling CODA.

XtreemOS project aims at building a Linux-based operating system to support virtual organizations for next generation Grids.

A virtual file system layer (VFS) that is portable and runs purely in user space. It provides an NFS v2 front end and a BSD-like VFS backend. Dynamic file system modules may be loaded to provide proxies, features or interfaces.

Glusterfs is a high performance filesystem from Red Hat. This Roll integrates Glusterfs in Rocks

This roll provides rpm packages to mount the lustre filesystem on the frontends and compute nodes of a rocks cluster. Please contact me if you need this roll for another kernel and/or lustre version.

XCPU is a suite of tools for cluster management. It includes utilities for job starting, cluster resource management, scalable distribution of boot images as well as creation and control of virtual machines in a cluster environment.

The EVMS Project uses a layered, plug-in model to provide unparalleled flexibility and extensibility in managing storage. This allows for easy expansion or customization of various levels of volume management.

Mutil is a set of standard utilities that have been parallelized to maximize performance on modern file systems. These currently include multi-threaded drop-in replacements for cp and md5sum from GNU coreutils, which have achieved 10/30x rates on one/many nodes.