Cookbook of SGLang - Recipe

A PyTorch native platform for training generative AI models

SGLang is a fast serving framework for large language models and vision language models.

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

​​Unlimited-length talking video generation​​ that supports image-to-video and video-to-video generation

🤗A PyTorch-native Inference Engine with Hybrid Cache Acceleration and Parallelism for DiTs: Z-Image, FLUX2, Qwen-Image, etc.

A high-throughput and memory-efficient inference and serving engine for LLMs

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

FlashInfer: Kernel Library for LLM Serving

My learning notes/codes for ML SYS.

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

Machine Learning Engineering Open Book

HunyuanVideo: A Systematic Framework For Large Video Generation Model

PyTorch native quantization and sparsity for training and inference

Fast and memory-efficient exact attention

TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.