Official code repository of "BERTology Meets Biology: Interpreting Attention in Protein Language Models."

Steps to reproduce training results for the paper Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?