Open Frontier Intelligence

MultiModal Audio Generation in Raw Waveform Space.

A toolbox for real-to-sim reconstruction and robotic simulation

Reference PyTorch implementation and models for DINOv3

ViPE: Video Pose Engine for Geometric 3D Perception

[ICCV 2025] SpatialTrackerV2: 3D Point Tracking Made Easy

Code for ICCV'2025 (Best student paper honorable mention) "RayZer: A Self-supervised Large View Synthesis Model"

MAGI-1: Autoregressive Video Generation at Scale

State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!

[CVPR 2025 Oral]Infinity ∞ : Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis

Simulation platform for general-purpose robotics & embodied AI learning.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

[NeurIPS 2024] Code release for "Segment Anything without Supervision"

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Official Implementation for CVPR 2024 paper: CLIP as RNN: Segment Countless Visual Concepts without Training Endeavor

Your image is almost there!

[CVPR2024, Highlight] Official code for DragDiffusion

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". A…

A family of lightweight multimodal models.

[RSS2024] A Multi-Modal Large Language Model with Retrieval-augmented In-context Learning capacity designed for generalisable and explainable end-to-end driving

Official Repo For OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]

[ICLR 2024 Spotlight] Official implementation of ScaleCrafter for higher-resolution visual generation at inference time.

Official Code for MotionCtrl [SIGGRAPH 2024]

IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks

[ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"

[ICLR 2024] Real-Fake: Effective Training Data Synthesis Through Distribution Matching

[arXiv:2309.16669] Code release for "Training a Large Video Model on a Single Machine in a Day"

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).