Stars
Official implementation of "Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization"
[ICLR2026] FlexiCodec: A Dynamic Neural Audio Codec for Low Frame Rates
Awesome Unified Multimodal Models
Github repository for ACL 2025 paper: Recent Advances in Speech Language Models: A Survey.
UniVoice: Unifying Autoregressive ASR and Flow-Matching based TTS with Large Language Models
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
SALMONN family: A suite of advanced multi-modal LLMs
Awesome speech/audio LLMs, representation learning, and codec models
Training code for FAcodec presented in NaturalSpeech3
A toolkit dedicate for speech evaluation.
PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech), Reproduced Demo https://lifeiteng.github.io/valle/index.html
Evaluation Protocol for Large-Scale Zero-Shot TTS Literature
컴퓨터 과학 키워드 총정리 / computer science keyword notes
CS231N 2017 video subtitles translation project for Korean Computer Science students
Making the world's first and smartest opensource any-to-any AGI system
A unified multimodal language model based on discrete sequence modeling
✨✨Latest Advances on Multimodal Large Language Models
Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)
Human Emotion Understanding using multimodal dataset.
Building a real-time environment using webcam frame division in OpenCV and classify cropped images using a fine-tuned vision transformers on hybryd datasets samples for facial emotion recognition.
A jupyter notebook showing how to finetune the vision transformer on a facial expression dataset (FER-2013)
This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.
CMU Lecture: Machine Learning In Production / AI Engineering / Software Engineering for AI-Enabled Systems (SE4AI)