A Python library encapsulating best practices for rubric-based evaluation of LLM/VLM outputs using LLM-as-a-judge.

A .claude slash command to manage a simple todo list in your project's root directory.

A few utilities for use on a SLURM cluster

Code for the "MedExpert: An Expert-Annotated Dataset for Medical Chatbot Evaluation" paper at Machine Learning for Health (ML4H) 2025.

Code for "Learning to summarize from human feedback"

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

Dataset and Evaluation Code for the K-QA Benchmark.

GoPro Labs

Control the quality of your labeled data with the Python tools you already know.

💫 A spaCy package for Yohei Tamura's Rust tokenizations library

Code for the MedRAG toolkit

An experimental Obsidian plugin that adds controls to embedded queries

Code for ACL 2022 Paper "SUMM^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents"

Download Reddit dumps from pushshift.io and extract only comments from specified subreddits

Calculate Krippendorff's Alpha on any DataFrame

An extensible WebComponents library for the Spatial Web

[NeurIPS 2023] "Rethinking Tokenizer and Decoder in Masked Graph Modeling for Molecules"

Extract and infer personal attributes from dialogue

Code and documentation to train Stanford's Alpaca models, and generate the data.

A Natural Language Inference (NLI) model based on Transformers (BERT and ALBERT)

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons

Datasets and code for a scientific paper about video game text corpora. Datasets contain text from Star Wars: Knights of the Old Republic (Bioware), TorchLight II (Runic Games) and The Elder Scroll…

official repo for AAAI ALOHA chatbot

This is a repository for our paper (PAED: Zero-Shot Persona Attribute Extraction in Dialogues) accepted in ACL'23.