Tiny-Attention Adapter: Contexts Are More Important Than the Number of Parameters
Tiny-AttentionAdapter:ContextsAreMoreImportantThantheNumberofParameters(Paperreading)HongyuZhao,UniversityofChicago,EMNLP2022,Cited:3,Code:None,Paper1.前言Adapter-tuning是一种范式,通过添加和调整少量新参数,将预训练语言模型转移到下游任