MOSS LORA 方式微调报错,RuntimeError: expected scalar type Half but found Float解决方案
最近用V100微调MOSS、ChatGLM等模型,过程中报错RuntimeError:expectedscalartypeHalfbutfoundFloat解决方案为:在model_class.model.from_pretrained(args.model_name_or_path,load_in_8bit=True,device_map=device_map)中将load_in_8bit=Tr