Skip to content

bjourne/jiang_y2024

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spatio-Temporal Approximation: A Training-Free SNN Conversion for Transformers

Requirements

torch==1.9.0+cu111
clip==1.0

Conversion Experiments on CIFAR-10

zeroshot experiment

python main.py --sample_data cifar10

standard experiment using finetuned model

python main.py --sample_data cifar10 --load_vcm --vcm_path finetuned_model_path

Conversion Experiments on CIFAR-10.1 & CIFAR-10.2

zeroshot experiment

python main.py --sample_data cifar10 --test_datas cifar101 cifar102

Currently, our experiments are done on GPUs based on high-precision floating-point computation, thus the cost of inference have not yet been optimized. Make sure you have 60G of memory available when you set batch_size=50. In future work, when this pipeline is succuessfully deployed on low-precion hardware platforms, memory and runtime will be effectively saved.

About

Work work work

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%