Code for our EMNLP 2025 paper - "Triangulating LLM Progress through Benchmarks, Games, and Cognitive Tests" (triangulating branch)

A Framework for the Systematic Evaluation of Chat-Optimized Language Models as Conversational Agents and an Extensible Benchmark

All you need to get started with the LM Playpen Environment for Learning in Interaction.

Collection of games to be run with the clembench framework

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

A Framework for the Systematic Evaluation of Chat-Optimized Language Models as Conversational Agents and an Extensible Benchmark

arXiv LaTeX Cleaner: Easily clean the LaTeX code of your paper to submit to arXiv

Pytorch implementation of Multi-Object Network(MONet)

Tensors, for human consumption

lilGym RL benchmark

This repository contains implementations and illustrative code to accompany DeepMind publications

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

Move and resize windows on macOS with keyboard shortcuts and snap areas

The entmax mapping and its loss, a family of sparse softmax alternatives.

Simple and easily configurable grid world environments for reinforcement learning

Video Platform for Action Recognition and Object Detection in Pytorch

ViNet Pushing the limits of Visual Modality for Audio Visual Saliency Prediction

Code and dataset release for Park et al., Robust Change Captioning (ICCV 2019)

Release of the pretrained S3D Network in PyTorch (ECCV 2018)

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

A community-maintained Python framework for creating mathematical animations.

Compact Bilinear Pooling for PyTorch

ISI Language Grounding and Generation Data

Neural network visualization toolkit for keras

StarCraft II Learning Environment