centos\macos安装horovod

##安装open MPI
安装参考

1. 下载open mpi：
   https://download.open-mpi.org/release/open-mpi/v4.0/openmpi-4.0.1.tar.gz

2. 编译安装

$ tar -xzvf openmpi-4.0.1.tar.gz
$ cd openmpi-4.0.1
$ ./configure --prefix=/usr/local
$ make -j
$ sudo make install

3. 配置环境~/.bashrc

export PATH="/usr/local/bin/:$PATH"
export LD_LIBRARY_PATH="/usr/local/bin:$LD_LIBRARY_PATH"

$ source ~/.bashrc

4. 安装horovod
   需要安装pytorch或tensorflow

$ pip install horovod