Ongoing research training transformer language models at scale, including: BERT & GPT-2

The official evaluation suite and dynamic data release for MixEval.

Safe-RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

A Port of Fréchet Inception Distance (FID score) to PyTorch