Official repository of 'Visual-RFT: Visual Reinforcement Fine-Tuning' & 'Visual-ARFT: Visual Agentic Reinforcement Fine-Tuning'’

Github Pages template based upon HTML and Markdown for personal, portfolio-based websites.

Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers

[RSS 2023] Diffusion Policy Visuomotor Policy Learning via Action Diffusion

Code for "When Should We Prefer State-to-Visual DAgger Over Visual Reinforcement Learning?"

An open-source framework for training large multimodal models.

The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''

Create a docker container that contains a MATLAB install

Official Task Suite Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"

[NeurIPS'23 Oral] Visual Instruction Tuning: LLaVA (Large Language-and-Vision Assistant) built towards GPT-4V level capabilities.

Docker image for LLaVA: Large Language and Vision Assistant

ALFWorld: Aligning Text and Embodied Environments for Interactive Learning

ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks

[NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning

Simple script to parallelize download and extract files for SA-1B Dataset.

Central code repository for CARLA research