Speedrunning PLM pretraining

ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.

OPUS-Rota5: A Highly Accurate Protein Side-chain Modeling Method with 3D-Unet and RotaFormer

The code needed to reproduce the experiments associated with Parkinson et al. 2023 for the xGPR library