A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.

The ultimate training toolkit for finetuning diffusion models

EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL

xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

An inference and training framework for multiple image input in Flux Kontext dev

Fast Diffusion Models with Transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

👁️ 🖼️ 🔥PyTorch Toolbox for Image Quality Assessment, including PSNR, SSIM, LPIPS, FID, NIQE, NRQM(Ma), MUSIQ, TOPIQ, NIMA, DBCNN, BRISQUE, PI and more...

A collection of resources on personalized image generation.

[ICLR'25 Oral] Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think

A Framework of Small-scale Large Multimodal Models