Open Source Distributed Computing Software

Tools for the Linux Kernel's network block device, allowing you to use remote block devices over a TCP/IP network. Note that we have moved to github: https://github.com/NetworkBlockDevice/nbd

DRBL provides diskless or systemless environment. It uses distributed hardware resources and makes it possible for clients to fully access local hardware. It also includes Clonezilla, a partition and disk cloning utility similar to Ghost.

Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. It is based on a hierarchical design targeted at federations of clusters. Supports clusters up to 2000 nodes in size.

openQRM is a web-based open source datacenter management and hybrid cloud computing platform that integrates flexibly with existing components in enterprise data centers. Releases available at https://github.com/openQRM/openqrm-community. Please visit http://www.openqrm-enterprise.com for latest 5.3 free Community Release. Includes important security updates, bugfixes and enhancements especially for KVM and Cloud plugin. openQRM abstracts Virtualization and supports the following virtualization technologies: KVM, XEN, Citrix XenServer, VMWare ESX & LXC. The Hybrid Cloud Connector in openQRM supports a range of private or public cloud providers to extend your infrastructure on demand via Amazon AWS, Eucalyptus or OpenStack. openQRM automates provisioning, virtualization, storage and configuration management, and it takes care of high-availability.

JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid.

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

BSPonMPI is an implementation of the BSPlib standard on top of MPI. Both MPI and BSPlib are API's of communication routines meant for parallel computing, but BSPlib is easier to learn and its performance easier to predict.

Based on the source code of Sun Grid Engine, we are continuing the open source development effort here on sourceforge.

An extensible framework for distributed computing on P2P grids. We support peaceful free and open research and build an internet supercomputer. We render movies, solve Eternity puzzles, predict climate and improve a ~30 GHz cluster of clients.

Postgres-XL is a PostgreSQL-based scale-out cluster that handles both OLTP write intensive workloads as well as OLAP/BI type of workloads thanks to MPP parallelism. Postgres-XL is fully ACID and supports cluster-wide Multi-version Concurrency Control (MVCC) for global consistency and performance. There are commercial companies such as 2ndQuadrant, who provide support and consulting around Postgres-XL. Please visit http://2ndquadrant.com/en/resources/postgres-xl/ for more details.

openMosix is a Linux kernel extension for single-system image clustering. Taking n PC boxes, openMosix gives users and applications the illusion of one single computer with n CPUs. openMosix is perfectly scalable and adaptive.

ClusterIt is a collection of clustering tools to allow simple administration of groups of UNIX machines. It can also be used to facilitate parallel shell scripting, and compiling.

Son of Grid Engine is a community continuation of the old Sun Grid Engine project. It aims to be a big superset of available free gridengine code and patches. The main site is currently https://arc.liv.ac.uk/trac/SGE/ and https://arc.liv.ac.uk/SGE/ but release files are inaccessible there and being hosted here.

Reliable group communication based on IP multicast and configurable protocol stack

GridSim allows modeling and simulation of entities in parallel and distributed computing systems such as users, applications, resources, and resource brokers/schedulers for design and evaluation of scheduling algorithms. http://www.gridbus.org/gridsim

A distributed, peer-to-peer, server-less communication & messaging solution for JAVA (JMS), C++ and .NET applications, integrates with JBoss, WebLogic & WebSphere. Offers guaranteed delivery, security and transactions. Supports TCP, SSL & HTTP protocols.

The OpenSSI project is a comprehensive clustering solution offering a full, highly available SSI environment for Linux. Goals for OpenSSI Clusters include availability, scalability and manageability, built from standard servers.

Python framework for concurrent, asynchronous, distributed communicating tasks for broad range of use cases, including public / private / hybrid cloud computing, fog / edge computing.

Distributed session caching tools and APIs, primarily for SSL/TLS servers though perhaps useful for other (non-SSL/TLS) circumstances. Also includes a self-contained network abstraction library (libnal), and the sslswamp SSL/TLS benchmark/test utility.

XDAQ is a software platform designed specifically for the development of distributed data acquisition systems. The development is carried out at CERN, the European Organization for Nuclear Research. Please visit http://xdaq.web.cern.ch

Slurm is a replacement for other resource management software and schedulers like gridengine or torque. The slurm roll integrates very well into a rocks clusters installation. In the folder addons, there are a lot of useful rolls for rocks clusters 6.1 and 6.2. These rolls do not depend on slurm. Please see Discussion for further information and support

Atomatrix is a multithreaded execution system of atomic matrices with a dynamic compiler and a network eviron. It is the next generation object-orientated environment. XML, MUD-OO CLI, GnucDNA support, windows and many subprojects are built-in.

Generic clustering/load-balancing platform (over a LAN or internet) using java based P2P Aorta workers that execute java "tasklets". Various tasklets can be implemented to solve fractals, process images, render webpages, crack RSA "brute force".

This project is a .NET implementation of the JavaSpace API along with the some examples using spaces. The software was written using the JavaSpace specification and not any other implementation. Persistence is provided via Bamboo Prevalence.

This is an opensource project for the calculation of the mathematical constant Pi. If you are a mathematician or programer please contribute ideas or code for this project. Non professionals are also welcome to contribute.