A latent text-to-image diffusion model

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

Let us control diffusion models!

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

A playbook for systematically maximizing the performance of deep learning models.

A generative world for general-purpose robotics & embodied AI learning.

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

MiniCPM-V 4.5: A GPT-4o Level MLLM for Single Image, Multi Image and High-FPS Video Understanding on Your Phone

🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

Janus-Series: Unified Multimodal Understanding and Generation Models

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

llama3 implementation one matrix multiplication at a time

Wan: Open and Advanced Large-Scale Video Generative Models

An open source implementation of CLIP.

text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

A collection of resources and papers on Diffusion Models

Solve puzzles. Learn CUDA.

Multi-Joint dynamics with Contact. A general purpose physics simulator.

Hackable and optimized Transformers building blocks, supporting a composable construction.

[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

tiny vision language model

A PyTorch implementation of EfficientNet

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

Using Low-rank adaptation to quickly fine-tune diffusion models.