Generative models for conditional audio generation

Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"

Unofficial PyTorch implementation of "Autoregressive Speech Synthesis without Vector Quantization (MELLE)"

State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.

Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"

[ACL 2025 Main] UniCodec: a unified audio codec with a single codebook to support multi-domain audio data, including speech, music, and sound

SoTA open-source TTS

🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!

Code for: "Long-Context Autoregressive Video Modeling with Next-Frame Prediction"

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Official PyTorch implementation of BigVGAN (ICLR 2023)

LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis

Train a 1B LLM with 1T tokens from scratch by personal

Use PEFT or Full-parameter to finetune 400+ LLMs (Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, ...) or 150+ MLLMs (Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, Inter…

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audi…

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

Interface for OuteTTS models.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A family of state-of-the-art Transformer-based audio codecs for low-bitrate high-quality audio coding.

Self-Supervised Speech Pre-training and Representation Learning Toolkit