Stars
A user-friendly & efficient knowledge distillation framework for LLMs, supporting off-policy, on-policy (OPD), cross-tokenizer, multimodal, and on-policy self-distillation.
The official implemention of "Prune-OPD: Efficient and Reliable On-Policy Distillation for Long-Horizon Reasoning"
Official PyTorch implementation of Dynamic-dLLM (ICLR 2026).
[ICLR 2026] Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decoding
Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models
A curated collection of papers and resources on On-Policy Distillation for Large Language Models.
🏡 GitHub Pages template for personal academic homepage
Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Principles" (Slow Fast Sampling).
Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"
Official implementation of "Diffusion Language Models Know the Answer Before Decoding"
SDAR (Synergy of Diffusion and AutoRegression), a large diffusion language model（1.7B, 4B, 8B, 30B）
Automatically crawl arXiv papers daily and summarize them using AI. Illustrating them using GitHub Pages.
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
[NeurIPS 2025] TTRL: Test-Time Reinforcement Learning
A project page template for academic papers. Demo at https://eliahuhorwitz.github.io/Academic-project-page-template/
[ICML2026] Official Pytorch Implement for "Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Models"
[ICML 2026 Outstanding Paper] Minimalist RL for Diffusion LLMs. 89.1% on GSM8K.
Fully open reproduction of DeepSeek-R1
The official GitHub repo for the survey paper "A Survey on Diffusion Language Models".
[ICLR 2026] Official repository of "Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models"
Official PyTorch implementation for "Large Language Diffusion Models"
Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu