High-performance distributed data shuffling (all-to-all) library for MoE training and inference

⏩ Ship faster with Continuous AI. Build and run custom agents across your IDE, terminal, and CI

Parse LaTeX math expressions

A lightweight LLM evaluation toolkit for RLinf. Support mathematical reasoning and long CoT tasks.

RLinf: Reinforcement Learning Infrastructure for Embodied and Agentic AI

nnScaler: Compiling DNN models for Parallel Training

BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search sc…

A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Kubernetes Scheduler for Deep Learning

AutoML - Hyper parameters search for scikit-learn pipelines using Microsoft NNI

General-Purpose Kubernetes Pod Controller

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Resource scheduling and cluster management for AI

Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).

MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Convert models between Caffe, Keras, MXNet, Tensorflow, CNTK, …

Dr. TLA+ series - learn an algorithm and protocol, study a specification

Accompanying Repository for The Verification of a Distributed System Talk

Production-Grade Container Scheduling and Management

Powerful system container and virtual machine manager

HyperContainer Daemon

Tiny Linux distro that runs the entire OS as Docker containers

FOEDUS main source code repository