Stars
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
torchax is a PyTorch frontend for JAX. It gives JAX the ability to author JAX programs using familiar PyTorch syntax. It also provides JAX-Pytorch interoperability, meaning, one can mix JAX & Pytor…
TPU inference for vLLM, with unified JAX and PyTorch support.
🚀 Efficient implementations of state-of-the-art linear attention models
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RN…
Muon is an optimizer for hidden layers in neural networks
A Datacenter Scale Distributed Inference Serving Framework
A collection of awesome-prompt-datasets, awesome-instruction-dataset, to train ChatLLM such as chatgpt 收录各种各样的指令数据集, 用于训练 ChatLLM 模型。
verl: Volcano Engine Reinforcement Learning for LLMs
SGLang is a fast serving framework for large language models and vision language models.
The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
LLM training code for Databricks foundation models
NumPy and SciPy on Multi-Node Multi-GPU systems
Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/
Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs
🔄 mpv player 播放器折腾记录 windows conf ； 中文注释配置 汉化文档 快速帮助入门 ； mpv-lazy 懒人包 win10 x64 config ； 着色器 shader 滤镜 filter 整合方案
Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/sp…
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
Neural network emulator for guitar amplifiers.