A Similarity Measure Based on Contrastive Learning

Parameter Decomposition

Accelerate pretraining by pre-pretraining on formal languages!

a home for Mike Bostock's versor.js

Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion models are significantly more data-efficient than standard left…

Official style files for papers submitted to venues of the Association for Computational Linguistics

Minimalistic large language model 3D-parallelism training

When is multilinguality a curse? Language modeling for 250 high- and low-resource languages (EMNLP 2024).

Machine Translation Dataset List and Some Useful Tools

NanoGPT (124M) in 90 seconds

Replace the default file explorer in Obsidian with a clean two-pane interface featuring folder tree, tag browsing, file previews, keyboard navigation, drag-and-drop, pinned notes, and customizable …

Fork of notebook navigator that adds support for navigating topics using typed links

Zotero is a free, easy-to-use tool to help you collect, organize, annotate, cite, and share your research sources.

Code and data for the RUIMTE paper

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

Monte Carlo tree search in JAX, with functionality to continue search from a previous subtree

PPO x Family DRL Tutorial Course（决策智能入门级公开课：8节课帮你盘清算法理论，理顺代码逻辑，玩转决策AI应用实践 ）

A benchmark environment for fully cooperative human-AI performance.

TUI for the Slurm Workload Manager

Orbax provides common checkpointing and persistence utilities for JAX users

Deep memory and sequence models in JAX

CleanRL's implementation of DeepMind's Podracer Sebulba Architecture for Distributed DRL

Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.

An implementation of MuZero in JAX.

SBX: Stable Baselines Jax (SB3 + Jax) RL algorithms