An implementation of IA3 from Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning in PyTorch.
Install with pip.
pip install git+https://github.com/oelin/ia3@misc{liu2022fewshot,
title={Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning},
author={Haokun Liu and Derek Tam and Mohammed Muqeeth and Jay Mohta and Tenghao Huang and Mohit Bansal and Colin Raffel},
year={2022},
eprint={2205.05638},
archivePrefix={arXiv},
primaryClass={cs.LG}
}