distillation

Implement a reasoning LLM in PyTorch from scratch, step by step

A unified inference and post-training framework for accelerated video generation.

Awesome Knowledge Distillation

TurboDiffusion: 100–200× Acceleration for Video Diffusion Models

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

Pytorch implementation of various Knowledge Distillation (KD) methods.

A PyTorch-based knowledge distillation toolkit for natural language processing

All-in-one training for vision models (YOLO, ViTs, RT-DETR, DINOv3): pretraining, fine-tuning, distillation.

PaddleSlim is an open-source library for deep model compression and architecture search.

Reinforcement Learning via Self-Distillation (SDPO)

致你忘不掉的那个TA，你们干大模型都是码圣 It's giving rebirth era. Welcome to Digital Life 1.0. 🫶

♾️ 开源数字永生框架 — 从聊天记录蒸馏任何人的七维数字分身。支持微信/飞书/iMessage/Telegram等12+平台，7种角色模板，对齐 OpenClaw Soul Spec 标准。一行指令让你的AI学会蒸馏。

NVIDIA FastGen: Fast Generation from Diffusion Models

[ICML 2026] Official codebase for "Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation" & Causal Forcing++

Generate High-Quality Synthetics, Train, Measure, and Evaluate in a Single Pipeline

Awesome List for On-Policy Distillation

mobilev2-yolov5s剪枝、蒸馏，支持ncnn，tensorRT部署。ultra-light but better performence！