model-distillation

Here are 29 public repositories matching this topic...

dkozlov / awesome-knowledge-distillation

Awesome Knowledge Distillation

deep-learning knowledge-distillation teacher-student knowledge-transfer co-training model-compression distillation kd knowldge-distillation distillation-model model-distillation

Updated Mar 22, 2026

autodistill / autodistill

Star

Images to inference with no labeling (use foundation models to train supervised models).

machine-learning computer-vision deep-learning image-annotation pytorch image-classification object-detection instance-segmentation labeling-tool multimodal yolov5 model-distillation foundation-models auto-labeling yolov8 segment-anything grounding-dino

Updated May 14, 2025
Python

Hramchenko / diffusion_distiller

Star

🚀 PyTorch Implementation of "Progressive Distillation for Fast Sampling of Diffusion Models(v-diffusion)"

image-generation denoising-diffusion model-distillation v-diffusion

Updated May 31, 2022
Python

kaiyuyue / mgd

Star

PyTorch Implementation of Matching Guided Distillation [ECCV'20]

deep-learning detection pytorch classification unsupervised-learning knowledge-distillation kd detectron2 mgd matching-guided-distillation model-distillation moco-v2

Updated Aug 7, 2021
Python

Mechanistically interpretable neurosymbolic AI (Nature Comput Sci 2024): losslessly compressing NNs to computer code and discovering new algorithms which generalize out-of-distribution and outperform human-designed algorithms

program-synthesis knowledge-distillation inductive-logic-programming domain-adaptation explainable-ai interpretable distilling neurosymbolic model-distillation out-of-distribution-generalization mechanistic-interpretability

Updated Feb 20, 2024
Python

bloomberg / minilmv2.bb

Star

Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)

python transformers pytorch language-model model-compression distillation model-distillation

Updated Jun 12, 2023
Python

frankaging / Causal-Distill

Star

The Codebase for Causal Distillation for Language Models (NAACL '22)

language-model model-compression bert-model distilbert model-distillation

Updated May 1, 2022
Python

jzuern / autograph-pub

Star

Repository for the publication "AutoGraph: Predicting Lane Graphs from Traffic"

neural-network graph-algorithms autonomous-driving self-supervised-learning model-distillation

Updated Sep 8, 2023
Python

mazumdarsoumya / TempoSyncDiff

Star

Few-step diffusion for audio-driven talking head generation making diffusion models speak faster without losing their composure.

computer-vision deep-learning video-generation diffusion-models model-distillation talking-face-generation latent-diffusion generative-ai temporal-consistency talking-head-generation audio-driven-animation

Updated Mar 19, 2026
Python

StarLight1212 / LLM-and-Generative-Models-Community

Star

AI Community Tutorial, including: LoRA/Qlora LLM fine-tuning, Training GPT-2 from scratch, Generative Model Architecture, Content safety and control implementation, Model distillation techniques, Dreambooth techniques, Transfer learning, etc for practice with real project!

machine-learning tutorial deep-neural-networks deep-learning pytorch generative-model transfer-learning explainable-ai rag model-distillation large-language-models llm peft-fine-tuning-llm ai-community

Updated Dec 23, 2024
Jupyter Notebook

frankaging / Causal-Distill-XXS

Star

The Codebase for Causal Distillation for Task-Specific Models

causality language-model natural-language-understanding model-distillation

Updated Nov 19, 2022
Python

mbar0075 / lupi-for-object-detection

Star

LUPI-OD - A novel methodology to improve object detection accuracy without increasing model size or complexity. | 2025 European Workshop on Visual Information Processing (EUVIP) | M.Sc. ICT (By Research) Dissertation | University of Malta