The repository provides code for running inference with the Meta Segment Anything Audio Model (SAM-Audio), links for downloading the trained model checkpoints, and example notebooks that show how t…

AcadHomepage: A Modern and Responsive Academic Personal Homepage

Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

Beta version for SLAM-LLM

Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, images, and video, as well as generating speech in real time.

Towards Comprehensive Benchmark for End-to-End Spoken Dialogue Models

OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model

GLM-4-Voice | 端到端中英语音对话模型

Kimi-Audio, an open-source audio foundation model excelling in audio understanding, generation, and conversation

MIO: A Foundation Model on Multimodal Tokens

Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and performing real-time speech generation.

Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"

Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

SALMONN: Speech Audio Language Music Open Neural Network

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

HumanOmni

Ola: Pushing the Frontiers of Omni-Modal Language Model

Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics, Fundamental Sciences such as Mathematics, and Ominous.

使用vllm加速cosyvoice2的推理

Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities。

The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.

Neural Networks: Zero to Hero-[My learning notes]