P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks
prompt-tuningv1当模型尺寸较小时,尤其是小于100亿个参数时,它仍然表现不佳。P-tuningv2是优化版本ofprefix-tuning,起源于使用deepprompttuning,在预训练模型的每一层使用continuousprompts,Deepprompttuning增加了continuousprompts的容量也缩小了在各种设置中进行微调的差距,尤其是对于小型模型和复杂任务