RuntimeError: Expected to have finished reduction in the prior iteration before starting a new one.
问题:非分布式训练时没有问题,使用多卡分布式训练时报错ErrormessageRuntimeError:Expectedtohavefinishedreductionintheprioriterationbeforestartinganewone.Thiserrorindicatesthatyourmodulehasparametersthatwerenotusedinproducingloss