Skip to content

mube1/thesis

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Improving Knowledge Distillation

Improving KD via reducing regularization.

To train

install requirments.txt
run python train.py with the following arguments :

  • teacher
  • student
  • learning rate
  • pruning rate
  • pruning mode
  • batch size
  • epochs
  • optimizer
  • temperature
  • etc ..

About

Thesis implementation

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages