Open Source Distributed Computing Software

Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. It is based on a hierarchical design targeted at federations of clusters. Supports clusters up to 2000 nodes in size.

Alluxio is the world’s first open source data orchestration technology for analytics and AI for the cloud. It bridges the gap between computation frameworks and storage systems, bringing data from the storage tier closer to the data driven applications. This enables applications to connect to numerous storage systems through a common interface. It makes data local, more accessible and as elastic as compute.

A general purpose implementation of the xmlrpc specification in C.

Infinispan is an open source, Java based data grid platform. ***IMPORTANT*** Starting with Infinispan 5.0.0.FINAL, Infinispan releases are no longer hosted in Sourceforge. They can now be located in www.jboss.org/infinispan/downloads

Distributed session caching tools and APIs, primarily for SSL/TLS servers though perhaps useful for other (non-SSL/TLS) circumstances. Also includes a self-contained network abstraction library (libnal), and the sslswamp SSL/TLS benchmark/test utility.

YaCy is a free search engine that anyone can use to build search the internet (www and ftp) or to create a search portal for others (internet or intranet). The scale of YaCy is limited only by the number of users and can index billions of web pages. In p2p mode it is fully decentralized, all users of the search engine network are equal and it is not possible for anyone to censor the content of the distributed index.

SQLREST enables access to a relational database as RESTful Web Service. Entities can be queried, created and modified using the HTTP methods GET, POST, PUT and DELETE.

A Console-based BitTorrent Client with built-in scheduler for handling multiple sessions. It is designed to manage sessions in queue easily without heavy-weight GUI. External module can search for new torrents in trackers and submit it automatically.

A framework for building, deploying and managing well-described REST-ful Web services, including REST-ful Web Services realizations for RSS, XML Topic Maps, Structured Arguments, and Workflow.

Retrieve files from a remote computer using a PDA/Pocket PC running Windows Mobile. Can access remote computers regardless the geographical position. Can work under WiFi, GPRS or any other wireless networks.

Shift is a lightweight framework for high performance local and remote file transfers that provides resiliency across a wide variety of failure scenarios through various techniques. These include end-to-end integrity via cryptographic hashes, throttling of transfers to prevent resource exhaustion, balancing transfers across resources based on load and availability, and parallelization of transfers across multiple source and destination hosts for increased redundancy and performance.

Alchemi is a .NET grid computing framework that allows you to painlessly aggregate the computing power of intranet and Internet-connected machines into a virtual supercomputer (computational grid) and to develop applications to run on the grid.

Syoncloud Logs enables you to process log files from various applications using Hadoop, Flume and HBase. It has an easy installation and configurations interface. It has Syoncloud HBase web client. It displays tree of HBase tables and column families linked to paginated grid of data.

Askemos is an autonomous, distributed operating system, which significantly raises the level of abstraction in comparison with todays operating systems. An alternativ, equally valid view is that of an XML object store with procedures in XSLT.

Brain Net. A Distributed Search Engine Network. Aims to be a scalable distributed search engine allowing dynamic connection of nodes. Performance depends on bandwidth.

FullAuto is a groundbreaking secure programming framework that enables FULL API access to any number of simultaneous persistent SSH and SFTP connections to remote resources and devices. With FullAuto, connections are PERSISTANT enabling state preservation of file system navigations, environment manipulations, and user context shifting. Output and error messages from remote commands are returned accurately from both STDOUT and STDERR channels. With FullAuto persisent SSH/SFTP connections, automated processes can be DYNAMIC, intelligent and responsive - precisely in the same manner that highly trained professionals work with SSH/SFTP tools, to perform countless tasks manually. FullAuto works with the naked protocol, and connects directly with ordinary SSH/SFTP servers that already exist on nearly every UNIX platform, and many Windows and MAC systems. NO OTHER REMOTE SOFTWARE IS NEEDED. FullAuto is written entirely in Perl and has been tested on Linux, UNIX and Windows with Cygwin.

LiveScreen makes it possible to publish GUI screenshots that users can interact with. Unlike other remote desktop solutions, no special client is required. Web browsers can act as clients without employing helper apps, plugins or Java.

Important information!!! The Mapbender project moved under the roof of the Open Source Geospatial Foundation at http://www.osgeo.org/. All downloads and information are linked from the project site at http://www.mapbender.org/

Google(™) meets the Matrix. Red Piranha combines Lucene (Searching Ability), XML-RDF (ability to learn), Tomcat (for P2P Power) and Spring (Ease of use) to not only let you find anything, anywhere, but to actually understand what you are looking for.

Named after a well know product from Microsoft, SandStorm is a framework for creating modular middle-end web products.

A command line utility to read a text file containing lines of data, clean up any CR/LF anomalies, and output the lines of text with clean CR/LF terminators to standard output. The binary is a Windows 32 bit console app.

UberMQ is a clean-room implementation of the JMS 1.1 API (topics and queues), based on Java NIO for speed and scalability. It supports TCP, SSL and LRMP multicast connectivity, and is highly pluggable so you can customize various aspects to your needs.

A universal platform for resource discovery and description that shares XML meta-data over existing peer-to-peer (P2P) networks such as Gnutella and JXTA.

pureIRCd is an IRC Server written C (though throughout the years i've used various programming languages, including VB6, VB.net C#, and am now stuck with C) to provide a fresh IRC (RFC1459) implementation and avoid the clutter of existing solutions.

ABQS Batch Queue System - Runs UNIX jobs in the background. Time consuming Jobs like Database-Queries can be started through simple cusom Web-Interfaces without the need to wait for their completion and thus risking a Browser-Timeout. Come back later to