[已解决]安装apex报错AttributeError: module ‘torch.distributed‘ has no attribute ‘_all_gather_base‘

1 安装apex之后，报错‘_all_gather_base‘

报错内容
AttributeError: module ‘torch.distributed‘ has no attribute ‘_all_gather_base‘

2 然后搜了这个博客（用了他的方法4）

https://huaweicloud.csdn.net/63806b92dacf622b8df87908.html?spm=1001.2101.3001.6661.1&utm_medium=distribute.pc_relevant_t0.none-task-blog-2~default~CTRLIST~activity-1-127585754-blog-128077560.235^v36^pc_relevant_default_base3&depth_1-utm_source=distribute.pc_relevant_t0.none-task-blog-2~default~CTRLIST~activity-1-127585754-blog-128077560.235^v36^pc_relevant_default_base3&utm_relevant_index=1https://huaweicloud.csdn.net/63806b92dacf622b8df87908.html?spm=1001.2101.3001.6661.1&utm_medium=distribute.pc_relevant_t0.none-task-blog-2~default~CTRLIST~activity-1-127585754-blog-128077560.235^v36^pc_relevant_default_base3&depth_1-utm_source=distribute.pc_relevant_t0.none-task-blog-2~default~CTRLIST~activity-1-127585754-blog-128077560.235^v36^pc_relevant_default_base3&utm_relevant_index=1

3 从新安装apex的时候，如果之前有安装apex，记得删除

pip uninstall apex

4 然后按照后面指令操作即可

git clone https://github.com/ptrblck/apex.git
cd apex
git checkout apex_no_distributed
pip install -v --no-cache-dir ./

5 但是遇到新的问题

AttributeError: module 'torch.nn' has no attribute 'backends'

现在参考这个博客

https://huaweicloud.csdn.net/63806b92dacf622b8df87908.html?spm=1001.2101.3001.6661.1&utm_medium=distribute.pc_relevant_t0.none-task-blog-2~default~CTRLIST~activity-1-127585754-blog-128077560.235^v36^pc_relevant_default_base3&depth_1-utm_source=distribute.pc_relevant_t0.none-task-blog-2~default~CTRLIST~activity-1-127585754-blog-128077560.235^v36^pc_relevant_default_base3&utm_relevant_index=1https://huaweicloud.csdn.net/63806b92dacf622b8df87908.html?spm=1001.2101.3001.6661.1&utm_medium=distribute.pc_relevant_t0.none-task-blog-2~default~CTRLIST~activity-1-127585754-blog-128077560.235^v36^pc_relevant_default_base3&depth_1-utm_source=distribute.pc_relevant_t0.none-task-blog-2~default~CTRLIST~activity-1-127585754-blog-128077560.235^v36^pc_relevant_default_base3&utm_relevant_index=1

git clone https://github.com/NVIDIA/apex
cd apex
pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./
 
或者
python setup.py install --cuda_ext --cpp_ext ./