Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Python bindings for MPI

Simplify HPC and Batch workloads on Azure

Parallel Programming Course

DeepHyper: A Python Package for Massively Parallel Hyperparameter Optimization in Machine Learning

Python extension language using accelerators

Analysis kit for large-scale structure datasets, the massively parallel way

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

Best practices & guides on how to write distributed pytorch training code

Distributed and decentralized training framework for PyTorch over graph

FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.

Zero-copy MPI communication of JAX arrays, for turbo-charged HPC applications in Python ⚡

PySM 3: Sky emission simulations for Cosmic Microwave Background experiments

Code for tutorials and examples

MPI wrapper generator, for writing PMPI tool libraries

Parallel InSAR processing for Time-series analysis

MPI Parallel framework for training deep learning models built in Theano

OpenClimateGIS is a set of geoprocessing and calculation tools for CF-compliant climate datasets.

DISROPT: A Python framework for distributed optimization

A common interface to processing pools.