LVS+keepalived构建PXC高可用集群

2019独角兽企业重金招聘Python工程师标准>>> hot3.png

1 高可用安装

1.1 集群信息

主机 IP 组件
bdc212 192.168.13.212

LVS:ipvsadm-1.27-7.el7.x86_64.rpm

Keepalived: keepalived-1.2.4.tar.gz

应用:Percona-XtraDB-Cluster
bdc213 192.168.13.213

LVS:ipvsadm-1.27-7.el7.x86_64.rpm

Keepalived: keepalived-1.2.4.tar.gz

应用:Percona-XtraDB-Cluster
bdc214 192.168.13.214

应用:Percona-XtraDB-Cluster

1.2 安装准备

  • 上传安装所需的压缩包到/opt目录

        keepalived-1.2.4.tar.gz

        (http://www.keepalived.org/software/keepalived-1.2.4.tar.gz)

  • 安装组件所需依赖包
yum install openssl-devel popt-devel libnl* -y

1.3 安装LVS+keepalived

        在两台Director Server上分别安装LVS+Keepalived,BACKUP服务器与MASTER服务器一致,先安装lvs再安装keepalived。

1.3.3 安装LVS

        Ipvs(IP Virtual Server)是整个负载均衡的基础,没有这个基础,故障隔离与失败切换就毫无意义了。

yum install ipvsadm –y

1.3.4 安装keepalived

解压包:

tar zxvf keepalived-1.2.4.tar.gz

初始化:

cd keepalived-1.2.4
./configure --prefix=/usr/local/keepalived 
Keepalived configuration
------------------------
Keepalived version       : 1.2.4
Compiler                 : gcc
Compiler flags           : -g -O2
Extra Lib                : -lpopt -lssl -lcrypto  -lnl
Use IPVS Framework       : Yes
IPVS sync daemon support : Yes
IPVS use libnl           : Yes
Use VRRP Framework       : Yes
Use VRRP VMAC            : Yes
Use Debug flags          : No

 编译并安装:

make&&make install
Make complete
make -C keepalived install
make[1]: Entering directory `/root/Desktop/keepalived-1.2.1/keepalived'
install -d /usr/local/keepalived/sbin
install -m 700 ../bin/keepalived /usr/local/keepalived/sbin/
install -d /usr/local/keepalived/etc/rc.d/init.d
install -m 755 etc/init.d/keepalived.init /usr/local/keepalived/etc/rc.d/init.d/keepalived
install -d /usr/local/keepalived/etc/sysconfig
install -m 755 etc/init.d/keepalived.sysconfig /usr/local/keepalived/etc/sysconfig/keepalived
install -d /usr/local/keepalived/etc/keepalived/samples
install -m 644 etc/keepalived/keepalived.conf /usr/local/keepalived/etc/keepalived/
install -m 644 ../doc/samples/* /usr/local/keepalived/etc/keepalived/samples/
install -d /usr/local/keepalived/share/man/man5
install -d /usr/local/keepalived/share/man/man8
install -m 644 ../doc/man/man5/keepalived.conf.5 /usr/local/keepalived/share/man/man5
install -m 644 ../doc/man/man8/keepalived.8 /usr/local/keepalived/share/man/man8
make[1]: Leaving directory `/root/Desktop/keepalived-1.2.1/keepalived'
make -C genhash install
make[1]: Entering directory `/root/Desktop/keepalived-1.2.1/genhash'
install -d /usr/local/keepalived/bin
install -m 755 ../bin/genhash /usr/local/keepalived/bin/
install -d /usr/local/keepalived/share/man/man1
install -m 644 ../doc/man/man1/genhash.1 /usr/local/keepalived/share/man/man1
make[1]: Leaving directory `/root/Desktop/keepalived-1.2.1/genhash'

1.4 配置路由转发

    1> 更改配置文件

vi /etc/sysctl.conf 

        net.ipv4.ip_forward = 1

    2> 刷新系统配置

sysctl -p

1.5 配置keepalived.cnf

        keepalived的配置分为三类: 全局配置(global configuration),VRRPD配置,LVS配置。

        全局配置就是对整个keepalived起效的配置,不管是否使用LVS。VRRPD是keepalived的核心,LVS配置只在要使用keepalived来配置的管理LVS时需要使用,如果仅仅使用keepalived来做HA,LVS的配置是不需要的。如果在只有一个负载均衡器的场合,就不须 VRRP 实例定义块。

mkdir /etc/keepalived
vi /etc/keepalived/keepalived.conf
! Configuration File for keepalived

global_defs {
   router_id LVS_MASTER            #BACKUP  LVS_BACKUP
}

vrrp_instance VI_1 {
    state MASTER                   #BACKUP  BACKUP
    interface eno16777736
    virtual_router_id 51
    priority 100                   #BACKUP  80
    advert_int 1
    nopreempt
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.252.199
    }
}
  
virtual_server 192.168.252.199 3306 {
    delay_loop 6
    lb_algo rr
    lb_kind NAT
#   persistence_timeout 5
    protocol TCP

    real_server 192.168.252.159 3306 {
        weight 3
        TCP_CHECK {
            connect_timeout 3
            nb_get_retry 3
            delay_before_retry 3
            connect_port 3306
        }
    }
   

    real_server 192.168.252.160 3306 {
        weight 3
        TCP_CHECK {
            connect_timeout 3
            nb_get_retry 3
            delay_before_retry 3
            connect_port 3306
        }
    }

    real_server 192.168.252.161 3306 {
        weight 3
        TCP_CHECK {
            connect_timeout 3
            nb_get_retry 3
            delay_before_retry 3
            connect_port 3306
        }
    }
}

        注:配置backup的/etc/keepalived/keepalived.conf,只需将批注部分改一下即可。

 

2 keepalived集群启动

2.1 master节点启动

/usr/local/keepalived/sbin/keepalived start

检查虚拟IP启动情况

方法1:

tail -30 /var/log/message
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Interface queue is empty
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: No such interface, virbr0
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: No such interface, virbr0-nic
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Registering Kernel netlink reflector
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Registering Kernel netlink command channel
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Registering gratuitous ARP shared channel
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Opening file '/etc/keepalived/keepalived.conf'.
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Configuration is using : 61916 Bytes
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Using LinkWatch kernel netlink reflector...
Jun 15 16:24:25 localhost Keepalived_healthcheckers[54296]: Activating healthchecker for service [192.168.252.199]:3306
Jun 15 16:24:25 localhost Keepalived_healthcheckers[54296]: Activating healthchecker for service [192.168.252.199]:3306
Jun 15 16:24:25 localhost Keepalived_healthcheckers[54296]: Activating healthchecker for service [192.168.252.199]:3306
Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: VRRP_Instance(VI_1) Transition to MASTER STATE
Jun 15 16:24:26 localhost Keepalived_vrrp[54297]: VRRP_Instance(VI_1) Entering MASTER STATE
Jun 15 16:24:26 localhost avahi-daemon[768]: Registering new address record for 192.168.252.199 on eno16777736.IPv4.

方法2:

[root@localhost Desktop]#ip addr

        150158_46aP_2812496.png

2.2 backup节点启动

/usr/local/keepalived/sbin/keepalived start

2.3 查看路由分发情况

查看ipvsadm

[root@localhost Desktop]#ipvsadm

        LVS+keepalived构建PXC高可用集群_第1张图片

也能够通过mysqladmin查看本地mysql服务连接状况

/opt/percona/bin/mysqladmin -uroot -p123456 status

        150434_Xvvq_2812496.png

 

3 PXC故障测试

3.1 杀死mysql服务

        杀死节点三上的mysql服务

kill -9 mysqld’s pid

3.2 查看ipvsadm

[root@localhost Desktop]# ipvsadm

        152304_aEIv_2812496.png

         注:负载均衡服务解除了节点三,只向节点一二分发包。

3.3 重启mysql服务

/usr/share/percona-xtradb-cluster/mysql.server start

3.4 再查看ipvsadm

[root@localhost Desktop]# ipvsadm

        152350_rPK2_2812496.png

        注:负载均衡服务重新把节点三放入了路由分发列表。

 

4 高可用测试

4.1 杀死master的KP服务

Kill -9 keepalived'pid

4.2 查看组建工作情况

    1> VIP持有情况:

        查看master ip:#ip add

            Master释放了VIP:192.168.13.100

        查看backup ip:#ip add

            Backup接收了VIP:192.168.13.100,继续提供负载均衡服务

    2> ipvsadm工作情况

查看master Ipvsadm:负载均衡没有工作

[root@localhost keepalived-1.2.4]# ipvsadm

         152545_gaUh_2812496.png

查看backup ipvsadm:负载均衡仍然提供服务

[root@localhost keepalived-1.2.4]# ipvsadm

        152557_sWk1_2812496.png

转载于:https://my.oschina.net/puwenchao/blog/753255

你可能感兴趣的:(LVS+keepalived构建PXC高可用集群)