【踩坑】ModuleNotFoundError: No module named ‘fused_layer_norm_cuda‘

在使用pytorch_pretrained_bert报错No module named ‘fused_layer_norm_cuda’，其实是apex的问题

原因是安装apex时没有安装cuda版本，所以要sudo pip uninstall apex卸载(apex文件夹也一起删除)后，重新安装，具体安装步骤如下：

git clone https://www.github.com/nvidia/apex
cd apex
sudo python setup.py install --cuda_ext --cpp_ext

————————————————
参考链接：
https://blog.csdn.net/Flying_sfeng/article/details/103314536
https://codeantenna.com/a/3qCY5kmOlI
https://www.it610.com/article/1295293602620055552.htm