A high-throughput and memory-efficient inference and serving engine for LLMs

Cross-platform transformer training

Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

Multilingual Document Layout Parsing in a Single Vision-Language Model

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

Examples and guides for using the OpenAI API

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation

Comparison on Single Token Prediction

Machine Learning Toolkit for Kubernetes

SGLang is yet another fast serving framework for large language models and vision language models.