nnScaler: Compiling DNN models for Parallel Training

TensorFlow code and pre-trained models for BERT

Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).

A resilient distributed training framework

[ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo

Tempo is a system for declarative, efficient, end-to-end compiled dynamic deep learning