Skip to content

yeates/Aurora

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

1 Commit
ย 
ย 

Repository files navigation

Aurora: Unified Video Editing with a Tool-Using Agent

Paper Website Code

This repository will host the official implementation of Aurora, an agentic video editing framework that pairs a tool-augmented vision-language model (VLM) agent with a unified video diffusion transformer. The VLM agent rewrites a raw user request into a typed edit plan (instruction, task label, image-search query, mask phrase) and dispatches it to the video DiT, resolving textual and visual underspecification before generation.

Features

  • ๐ŸŽฌ Unified video editing - replacement, removal, style transfer, and reference-driven insertion under one set of weights
  • ๐Ÿค– Tool-using VLM agent - rewrites a raw user request into a four-field edit plan
  • ๐Ÿ” Resolves underspecification - fills in missing reference images via web image search and missing masks via grounded segmentation
  • ๐Ÿ“Š AgentEdit-Bench - evaluates agent-enhanced video editing under textual and visual underspecification

TODO

  • [] The code is being prepared for release. ETA: late May 2026.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors