Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

AfriNLLB: Efficient Translation Models for African Languages

Hundreds of models & providers. One command to find what runs on your hardware.

Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.

VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

Arabic Arud (prosody) toolkit for Python. Features meter detection, tafeela analysis, and support for all 16 poetic meters with strict type safety.

Talk with Reachy Mini!

Reachy Mini's SDK

SGLang is a high-performance serving framework for large language models and multimodal models.

verl: Volcano Engine Reinforcement Learning for LLMs

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Machine Learning Systems

A curated list of awesome works in Routing LLMs paradigm (👉 Welcome to submit your contributions to this code repository)

The goal here is to get your hands dirty asap!

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba

Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"

[ECCV] HYDRA: A Hyper Agent for Dynamic Compositional Visual Reasoning

Benchmarking framework for evaluating vLLM serving performance across different configurations, models, and system settings. Includes tools for automated testing, latency/throughput analysis, and r…

vLLM Router

A modern replacement for ‘ls’.

A cat(1) clone with wings.

A smarter cd command. Supports all major shells.

A curated list of Awesome-LLM-Ensemble papers for the survey "Harnessing Multiple Large Language Models: A Survey on LLM Ensemble"

Telco-RAG is a specialized Retrieval-Augmented Generation (RAG) framework for 3GPP documents

[INTERSPEECH 2024] Official code for VoxSim: A perceptual voice similarity dataset