Tensors and Dynamic neural networks in Python with strong GPU acceleration

PyTorch tutorials.

MOSS-Speech is a true speech-to-speech large language model without text guidance.

A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

MOSS-TTSD is a spoken dialogue generation model that enables expressive dialogue speech synthesis in both Chinese and English, supporting zero-shot multi-speaker voice cloning, and long-form speech…

Ongoing research training transformer models at scale

GPT-4o-level, real-time spoken dialogue system.

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.

Collaborative Training of Large Language Models in an Efficient Way