Text-audio foundation model from Boson AI

PyTorch video decoding

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

A lightweight library for portable low-level GPU computation using WebGPU.

veRL: Volcano Engine Reinforcement Learning for LLM

Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of papers on accelerating LLMs, currently focusing mainly on infer…

Audio Large Language Models

A high-level API to control headless Chrome or Chromium over the DevTools Protocol. It is the Rust equivalent of Puppeteer, a Node library maintained by the Chrome DevTools team.

This is a simple demonstration of more advanced, agentic patterns built on top of the Realtime API.

Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"

A high-throughput and memory-efficient inference and serving engine for LLMs

A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

Large Language Model Text Generation Inference

Tensor library for machine learning

Stable Diffusion in pure C/C++

leaked prompts of GPTs

MLX: An array framework for Apple silicon

Consistency Distilled Diff VAE

Python SQL Parser and Transpiler

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

A network filesystem client to connect to SSH servers

NeRFshop: Interactive Editing of Neural Radiance Fields