Openstack Kolla-Ansible安装部署
部署节点制作
环境准备
-
CentOS环境安装
- 配置国内pypi源：
mkdir -p ~/.config/pip/ vim ~/.config/pip/pip.conf [global] index-url = https://mirrors.ustc.edu.cn/pypi/web/simple format = columns- CentOS 部分常用软件安装
yum install -y vim net-tools bash-completion-extras git -
安装依赖
- pip
yum install -y python-pip pip install --upgrade pip- 软件依赖
yum install -y python-devel libffi-devel gcc openssl-devel libselinux-python- ansible 安装
yum install -y ansible pip install -U ansible- 修改ansible配置文件
/etc/ansible/ansible.cfg：
[defaults] host_key_checking=False pipelining=True forks=100
安装docker-ce
cd /etc/yum.repos.d/
wget https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo
yum install docker-ce -y
开启 Docker 的共享挂载功能：所谓共享挂载即同一个目录或设备可以挂载到多个不同的路径并且能够保持互相之间的共享可见性，类似于 mount --shared。在 OpenStack for Kolla 中，主要解决 Neutron 的 namespace 在不同 container 中得以保持实效性的问题。
mkdir /etc/systemd/system/docker.service.d
tee /etc/systemd/system/docker.service.d/kolla.conf << 'EOF'
> [Service]
> MountFlags=shared
> EOF
使用阿里的加速器(登陆阿里云–>控制台–>产品与服务–>容器镜像服务–>镜像加速器 即可获取加速器地址)
mkdir -p /etc/docker
tee /etc/docker/daemon.json <<-'EOF'
{
"registry-mirrors": ["https://mb8n4btz.mirror.aliyuncs.com"]
}
EOF
启动docker服务
systemctl enable docker.service
systemctl start docker.service
Kolla-Ansible 安装
Kolla-Ansible 可以从pip安装，也可以从git安装，这里从git安装
- clone 代码
git clone https://github.com/openstack/kolla
git clone https://github.com/openstack/kolla-ansible
- 安装
pip install -r kolla/requirements.txt
pip install -r kolla-ansible/requirements.txt
python kolla-ansible/setup.py install
注意：
如果出现requests 2.20.0 has requirement idna<2.8,>=2.5, but you'll have idna 2.4 which is incompatible.错误，则强制更新requets库
pip install --ignore-installed requests
同样，出现Cannot uninstall 'PyYAML'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.错误，强制更新
sudo pip install --ignore-installed PyYAML
- copy
globals.ymlpasswords.ymlto/etc/kolla
mkdir -p /etc/kolla
cp -r kolla-ansible/etc/kolla/* /etc/kolla
- 配置安装目录
mkdir dep-158
cp kolla-ansible/ansible/inventory/* ./dep-158
制作本地镜像源
- 修改kolla镜像有关配置
vim /etc/kolla/globals.yml
openstack_release: "rocky"
network_interface: "ens192"
- 拉取镜像
kolla-ansible pull -vvv
- 启动容器
mkdir -p /var/www/html/registry
# docker run -d -p 5000:5000 -v /var/www/html/registry:/var/lib/registry --restart=always --name registry registry:2.6.2
- 修改docker配置,
10.10.129.151是ens192的ip
vim /etc/docker/daemon.json
{
"registry-mirrors": ["https://mb8n4btz.mirror.aliyuncs.com"],
"insecure-registries":["10.10.129.151:5000"]
}
- 修改镜像tag
for i in `docker images|grep -v registry|grep -v R|awk '{print $1}'`;do docker image tag $i:rocky 10.10.129.151:5000/$i:rocky;done
- 上传镜像到私有镜像仓库
for i in `docker images|grep 10.10.129.151|awk '{print $1}'`;do docker push $i:rocky;done
- 查看镜像是否上传成功
curl -XGET http://10.10.129.151:5000/v2/_catalog
- 备份镜像文件
tar -zcvf kolla-openstack-queens-registry.tar.gz /var/www/html/registry
Openstack 部署
环境说明
部署配置
kolla自带了all-in-one和多节点的两种部署方式，需要配置ansible 部署文件
- multinode部署文件修改
[control]
10.0.0.[10:12] ansible_user=ubuntu ansible_password=foobar ansible_become=true
# Ansible supports syntax like [10:12] - that means 10, 11 and 12.
# Become clause means "use sudo".
[network:children]
control
# when you specify group_name:children, it will use contents of group specified.
[compute]
10.0.0.[13:14] ansible_user=ubuntu ansible_password=foobar ansible_become=true
[monitoring]
10.0.0.10
# This group is for monitoring node.
# Fill it with one of the controllers' IP address or some others.
[storage:children]
compute
[deployment]
localhost ansible_connection=local become=true
# use localhost and sudo
说明：
- Ansible官方文档
- 部署中使用的密码存储在/etc/kolla/passwords.yml文件中。通过运行下面命令生成随机密码,初始化之后，可手动更改
keystone_admin_password密码（OpenStack登录密码）
kolla-genpwd
vim /etc/kolla/passwords.yml
keystone_admin_password: password
部署
- 确认inventory配置文件是否正确
ansible -m ping all -i ./multinode
结果：
localhost | SUCCESS => {
"changed": false,
"ping": "pong"
}
10.10.129.158 | SUCCESS => {
"changed": false,
"ping": "pong"
}
10.10.129.159 | SUCCESS => {
"changed": false,
"ping": "pong"
}
- 向各个节点安装基本依赖，如docker等；
修改docker yum源。https 有时会报ssl的错误，这里替换为http，也可以修改成本地源
vim /usr/share/kolla-ansible/ansible/roles/baremetal/defaults/main.yml
docker_yum_url: "http://yum.dockerproject.org"
如果打开了octavia，需要在/var/lib/kolla/config_files路径下制作证书文件
mkdir -p /etc/kolla/config/octavia
git clone https://github.com/openstack/octavia.git
source create_certificates.sh /etc/kolla/config/octavia/ /home/octavia/etc/certificates/openssl.cnf
# 注意 /home/octavia/etc/certificates/openssl.cnf 为octavia的代码路径下的文件
cp /etc/kolla/config/octavia/private/* /etc/kolla/config/octavia/
# -vvv 可以打印出最详细的信息
kolla-ansible -i ./multinode bootstrap-servers -vvv
- 对主机执行预部署检查
kolla-ansible -i ./multinode prechecks -vv
- 执行OpenStack部署
kolla-ansible -i ./multinode deploy -vv
- 使用OpenStack
kolla-ansible post-deploy
. /etc/kolla/admin-openrc.sh
一些注意事项
- 部署过程中所有的
ansible task都在/usr/share/kolla-ansible/ansible/roles/glance/tasks/下面，可以查看；
参考文档
- kolla-ansible部署OpenStack多节点
- kolla构建openstack镜像的本地yum源配置
- kolla-openstack-queens-本地镜像
- Openstack kolla-ansible