大纲
一、系统环境及所需软件包
二、高可用环境准备工作
三、DRBD的安装与基本配置
四、MySQL的安装与基本配置
五、Corosync的安装与基本配置
六、基于crm配置资源
一、系统环境及所需软件包
系统环境
CentOS5.8 x86_64
node1.network.com node1 172.16.1.101
node2.network.com node2 172.16.1.105
软件包
drbd83-8.3.15-2.el5.centos.x86_64.rpm
kmod-drbd83-8.3.15-3.el5.centos.x86_64.rpm
mysql-5.5.28-linux2.6-x86_64.tar.gz
corosync-1.2.7-1.1.el5.x86_64.rpm
pacemaker-1.0.12-1.el5.centos.x86_64.rpm
拓扑图
二、高可用环境准备工作
1、时间同步
[root@node1 ~]# ntpdate s2c.time.edu.cn [root@node2 ~]# ntpdate s2c.time.edu.cn 可根据需要在每个节点上定义crontab任务 [root@node1 ~]# which ntpdate /sbin/ntpdate [root@node1 ~]# echo "*/5 * * * * /sbin/ntpdate s2c.time.edu.cn &> /dev/null" >> /var/spool/cron/root [root@node1 ~]# crontab -l */5 * * * * /sbin/ntpdate s2c.time.edu.cn &> /dev/null
2、主机名称要与uname -n保持一致，并通过/etc/hosts解析
node1 [root@node1 ~]# hostname node1.network.com [root@node1 ~]# uname -n node1.network.com [root@node1 ~]# sed -i 's@\(HOSTNAME=\).*@\1node1.network.com@g' /etc/sysconfig/network node2 [root@node2 ~]# hostname node2.network.com [root@node2 ~]# uname -n node2.network.com [root@node2 ~]# sed -i 's@\(HOSTNAME=\).*@\1node2.network.com@g' /etc/sysconfig/network node1添加hosts解析 [root@node1 ~]# vim /etc/hosts [root@node1 ~]# cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 172.16.1.101 node1.network.com node1 172.16.1.105 node2.network.com node2 拷贝此hosts文件至node2 [root@node1 ~]# vim /etc/hosts [root@node1 ~]# cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 172.16.1.101 node1.network.com node1 172.16.1.105 node2.network.com node2 [root@node1 ~]# scp /etc/hosts node2:/etc/ The authenticity of host 'node2 (172.16.1.105)' can't be established. RSA key fingerprint is 13:42:92:7b:ff:61:d8:f3:7c:97:5f:22:f6:71:b3:24. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'node2,172.16.1.105' (RSA) to the list of known hosts. root@node2's password: hosts 100% 233 0.2KB/s 00:00
3、ssh互信通信
node1 [root@node1 ~]# ssh-keygen -t rsa -f ~/.ssh/id_rsa -P '' Generating public/private rsa key pair. /root/.ssh/id_rsa already exists. Overwrite (y/n)? n # 我这里已经生成过了 [root@node1 ~]# ssh-copy-id -i ~/.ssh/id_rsa.pub node2 root@node2's password: Now try logging into the machine, with "ssh 'node2'", and check in: .ssh/authorized_keys to make sure we haven't added extra keys that you weren't expecting. [root@node1 ~]# setenforce 0 [root@node1 ~]# ssh node2 'ifconfig' eth0 Link encap:Ethernet HWaddr 00:0C:29:D6:03:52 inet addr:172.16.1.105 Bcast:255.255.255.255 Mask:255.255.255.0 inet6 addr: fe80::20c:29ff:fed6:352/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:9881 errors:0 dropped:0 overruns:0 frame:0 TX packets:11220 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:5898514 (5.6 MiB) TX bytes:1850217 (1.7 MiB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:16 errors:0 dropped:0 overruns:0 frame:0 TX packets:16 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:1112 (1.0 KiB) TX bytes:1112 (1.0 KiB) 同理node2也需要做同样的双击互信，一样的操作，此处不再演示
4、关闭iptables和selinux
node1
[root@node1 ~]# service iptables stop [root@node1 ~]# vim /etc/sysconfig/selinux [root@node1 ~]# cat /etc/sysconfig/selinux # This file controls the state of SELinux on the system. # SELINUX= can take one of these three values: # enforcing - SELinux security policy is enforced. # permissive - SELinux prints warnings instead of enforcing. # disabled - SELinux is fully disabled. #SELINUX=permissive SELINUX=disabled # SELINUXTYPE= type of policy in use. Possible values are: # targeted - Only targeted network daemons are protected. # strict - Full SELinux protection. SELINUXTYPE=targeted
node2
[root@node2 ~]# service iptables stop [root@node2 ~]# vim /etc/sysconfig/selinux [root@node2 ~]# cat /etc/sysconfig/selinux # This file controls the state of SELinux on the system. # SELINUX= can take one of these three values: # enforcing - SELinux security policy is enforced. # permissive - SELinux prints warnings instead of enforcing. # disabled - SELinux is fully disabled. #SELINUX=permissive SELINUX=disabled # SELINUXTYPE= type of policy in use. Possible values are: # targeted - Only targeted network daemons are protected. # strict - Full SELinux protection. SELINUXTYPE=targeted
三、DRBD的安装与基本配置
1、配置163源(也可以自行下载两个软件包，我这里直接使用yum源)
node1
[root@node1 ~]# wget http://mirrors.163.com/.help/CentOS5-Base-163.repo [root@node1 ~]# yum repolist Loaded plugins: fastestmirror, security Loading mirror speeds from cached hostfile * epel: mirrors.hustunique.com repo id repo name status addons CentOS-5 - Addons - 163.com 0 base CentOS-5 - Base - 163.com 3,667 epel Extra Packages for Enterprise Linux 5 - x86_64 6,755 extras CentOS-5 - Extras - 163.com 266 updates CentOS-5 - Updates - 163.com 593 repolist: 11,281
node2
[root@node2 ~]# wget http://mirrors.163.com/.help/CentOS5-Base-163.repo [root@node1 ~]# yum repolist Loaded plugins: fastestmirror, security Loading mirror speeds from cached hostfile * epel: mirrors.hustunique.com repo id repo name status addons CentOS-5 - Addons - 163.com 0 base CentOS-5 - Base - 163.com 3,667 epel Extra Packages for Enterprise Linux 5 - x86_64 6,755 extras CentOS-5 - Extras - 163.com 266 updates CentOS-5 - Updates - 163.com 593 repolist: 11,281
2、安装drbd与kmod-drbd
node1 [root@node1 ~]# yum install -y drbd83 kmod-drbd83 node2 [root@node2 ~]# yum install -y drbd83 kmod-drbd83
3、准备分区作为drbd设备
node1 [root@node1 ~]# fdisk /dev/hda The number of cylinders for this disk is set to 44384. There is nothing wrong with that, but this is larger than 1024, and could in certain setups cause problems with: 1) software that runs at boot time (e.g., old versions of LILO) 2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK) Command (m for help): n Command action e extended p primary partition (1-4) p Partition number (1-4): 1 First cylinder (1-44384, default 1): Using default value 1 Last cylinder or +size or +sizeM or +sizeK (1-44384, default 44384): +1G Command (m for help): p Disk /dev/hda: 21.4 GB, 21474836480 bytes 15 heads, 63 sectors/track, 44384 cylinders Units = cylinders of 945 * 512 = 483840 bytes Device Boot Start End Blocks Id System /dev/hda1 1 2068 977098+ 83 Linux Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. Syncing disks. [root@node1 ~]# partprobe /dev/hda [root@node1 ~]# cat /proc/partitions major minor #blocks name 3 0 20971520 hda 3 1 977098 hda1 8 0 20971520 sda 8 1 104391 sda1 8 2 20860402 sda2 253 0 18776064 dm-0 253 1 2064384 dm-1 node2 [root@node2 ~]# fdisk /dev/hda Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel Building a new DOS disklabel. Changes will remain in memory only, until you decide to write them. After that, of course, the previous content won't be recoverable. The number of cylinders for this disk is set to 44384. There is nothing wrong with that, but this is larger than 1024, and could in certain setups cause problems with: 1) software that runs at boot time (e.g., old versions of LILO) 2) booting and partitioning software from other OSs (e.g., DOS FDISK, OS/2 FDISK) Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite) Command (m for help): n Command action e extended p primary partition (1-4) p Partition number (1-4): 1 First cylinder (1-44384, default 1): Using default value 1 Last cylinder or +size or +sizeM or +sizeK (1-44384, default 44384): +1G Command (m for help): p Disk /dev/hda: 21.4 GB, 21474836480 bytes 15 heads, 63 sectors/track, 44384 cylinders Units = cylinders of 945 * 512 = 483840 bytes Device Boot Start End Blocks Id System /dev/hda1 1 2068 977098+ 83 Linux Command (m for help): w The partition table has been altered! Calling ioctl() to re-read partition table. Syncing disks. [root@node2 ~]# partprobe /dev/hda [root@node2 ~]# cat /proc/partitions major minor #blocks name 3 0 20971520 hda 3 1 977098 hda1 8 0 20971520 sda 8 1 104391 sda1 8 2 20860402 sda2 253 0 18776064 dm-0 253 1 2064384 dm-1
4、编辑主配置文件
[root@node1 ~]# cat /etc/drbd.conf
#
# please have a a look at the example configuration file in
# /usr/share/doc/drbd83/drbd.conf
#
[root@node1 ~]# cp /usr/share/doc/drbd83-8.3.15/drbd.conf /etc/drbd.conf
cp: overwrite `/etc/drbd.conf'? y
[root@node1 ~]# cat /etc/drbd.conf
# You can find an example in /usr/share/doc/drbd.../drbd.conf.example
include "drbd.d/global_common.conf";
include "drbd.d/*.res";
编辑全局属性定义配置文件
[root@node1 ~]# vim /etc/drbd.d/global_common.conf
[root@node1 ~]# cat /etc/drbd.d/global_common.conf
global {
usage-count no; # 关闭用户数量统计
# minor-count dialog-refresh disable-ip-verification
}
common {
protocol C;
handlers {
# These are EXAMPLE handlers only.
# They may have severe implications,
# like hard resetting the node under certain circumstances.
# Be careful when chosing your poison.
pri-on-incon-degr "/usr/lib/drbd/notify-pri-on-incon-degr.sh; /usr/lib/drbd/notify-emergency-reboot.sh; echo b > /proc/sysrq-trigger ; reboot -f";
pri-lost-after-sb "/usr/lib/drbd/notify-pri-lost-after-sb.sh; /usr/lib/drbd/notify-emergency-reboot.sh; echo b > /proc/sysrq-trigger ; reboot -f";
local-io-error "/usr/lib/drbd/notify-io-error.sh; /usr/lib/drbd/notify-emergency-shutdown.sh; echo o > /proc/sysrq-trigger ; halt -f";
# fence-peer "/usr/lib/drbd/crm-fence-peer.sh";
# split-brain "/usr/lib/drbd/notify-split-brain.sh root";
# out-of-sync "/usr/lib/drbd/notify-out-of-sync.sh root";
# before-resync-target "/usr/lib/drbd/snapshot-resync-target-lvm.sh -p 15 -- -c 16k";
# after-resync-target /usr/lib/drbd/unsnapshot-resync-target-lvm.sh;
}
startup {
# wfc-timeout degr-wfc-timeout outdated-wfc-timeout wait-after-sb
}
disk {
on-io-error detach; # 一旦io发生错误，就拆掉磁盘
# on-io-error fencing use-bmbv no-disk-barrier no-disk-flushes
# no-disk-drain no-md-flushes max-bio-bvecs
}
net {
cram-hmac-alg "sha1"; # 指定加密算法
shared-secret "qYQ1cwOFC6E="; # 指定共享的密钥
# sndbuf-size rcvbuf-size timeout connect-int ping-int ping-timeout max-buffers
# max-epoch-size ko-count allow-two-primaries cram-hmac-alg shared-secret
# after-sb-0pri after-sb-1pri after-sb-2pri data-integrity-alg no-tcp-cork
}
syncer {
rate 300M; # 指定速率
# rate after al-extents use-rle cpu-mask verify-alg csums-alg
}
}
5、定义一个资源文件/etc/drbd.d/mysql.res
[root@node1 ~]# vim /etc/drbd.d/mysql.res
[root@node1 ~]# cat /etc/drbd.d/mysql.res
resource mysql {
on node1.network.com {
device /dev/drbd0;
disk /dev/hda1;
address 172.16.1.101:7789;
meta-disk internal;
}
on node2.network.com {
device /dev/drbd0;
disk /dev/hda1;
address 172.16.1.105:7789;
meta-disk internal;
}
}
将配置文件与资源文件拷贝至node2节点
[root@node1 ~]# scp -r /etc/drbd.* node2:/etc/
drbd.conf 100% 133 0.1KB/s 00:00
global_common.conf 100% 1688 1.7KB/s 00:00
mysql.res 100% 292 0.3KB/s 00:00
6、在两个节点上初始化已定义的资源并启动服务
初始化资源，两个节点同时执行 [root@node1 ~]# drbdadm create-md mysql Writing meta data... initializing activity log NOT initialized bitmap New drbd meta data block successfully created. [root@node2 ~]# drbdadm create-md mysql Writing meta data... initializing activity log NOT initialized bitmap New drbd meta data block successfully created. 启动drbd服务，两个节点同时执行 [root@node1 ~]# service drbd start Starting DRBD resources: [ d(mysql) s(mysql) n(mysql) ]...... [root@node2 ~]# service drbd start Starting DRBD resources: [ d(mysql) s(mysql) n(mysql) ]. 查看启动状态 [root@node1 ~]# cat /proc/drbd version: 8.3.15 (api:88/proto:86-97) GIT-hash: 0ce4d235fc02b5c53c1c52c53433d11a694eab8c build by [email protected], 2013-03-27 16:01:26 0: cs:Connected ro:Secondary/Secondary ds:Inconsistent/Inconsistent C r----- ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:977028 也可以使用drbd-overview命令来查看 [root@node1 ~]# drbd-overview 0:mysql Connected Secondary/Secondary Inconsistent/Inconsistent C r----- 从上面的信息中可以看出此时两个节点均处于Secondary状态。 于是，我们接下来需要将其中一个节点设置为Primary。在要设置为Primary的节点上执行如下命令 [root@node1 ~]# drbdadm -- --overwrite-data-of-peer primary mysql 而后再次查看状态，可以发现数据同步过程已经开始 [root@node1 ~]# cat /proc/drbd version: 8.3.15 (api:88/proto:86-97) GIT-hash: 0ce4d235fc02b5c53c1c52c53433d11a694eab8c build by [email protected], 2013-03-27 16:01:26 0: cs:SyncSource ro:Primary/Secondary ds:UpToDate/Inconsistent C r---n- ns:169252 nr:0 dw:0 dr:177024 al:0 bm:10 lo:4 pe:12 ua:64 ap:0 ep:1 wo:b oos:809220 [==>.................] sync'ed: 17.6% (809220/977028)K finish: 0:00:09 speed: 83,904 (83,904) K/sec 等数据同步完成以后再次查看状态，可以发现节点已经处于实时状态，且节点已经有了主次 [root@node1 ~]# drbd-overview # Primary/Secondary表示当前节点为主，对等节点为从 0:mysql Connected Primary/Secondary UpToDate/UpToDate C r-----
7、创建文件系统并挂载
文件系统的挂载只能在Primary节点进行，因此，也只有在设置了主节点后才能对drbd设备进行格式化 [root@node1 ~]# mke2fs -j /dev/drbd0 mke2fs 1.39 (29-May-2006) Filesystem label= OS type: Linux Block size=4096 (log=2) Fragment size=4096 (log=2) 122368 inodes, 244257 blocks 12212 blocks (5.00%) reserved for the super user First data block=0 Maximum filesystem blocks=251658240 8 block groups 32768 blocks per group, 32768 fragments per group 15296 inodes per group Superblock backups stored on blocks: 32768, 98304, 163840, 229376 Writing inode tables: done Creating journal (4096 blocks): done Writing superblocks and filesystem accounting information: done This filesystem will be automatically checked every 25 mounts or 180 days, whichever comes first. Use tune2fs -c or -i to override. 创建挂载目录 [root@node1 ~]# mkdir /mydata 挂载drbd设备，注意，只有主节点才能挂载，当前node1节点是主节点 [root@node1 ~]# mount /dev/drbd0 /mydata/ [root@node1 ~]# ls /mydata/ lost+found
四、MySQL的安装与基本配置
1、两节点上创建mysql用户
node1
[root@node1 ~]# groupadd -g 3306 mysql [root@node1 ~]# useradd -u 3306 -g mysql -s /sbin/nologin -M -d /mydata/data mysql [root@node1 ~]# id mysql uid=3306(mysql) gid=3306(mysql) groups=3306(mysql)
node2
[root@node1 ~]# groupadd -g 3306 mysql [root@node1 ~]# useradd -u 3306 -g mysql -s /sbin/nologin -M -d /mydata/data mysql [root@node1 ~]# id mysql uid=3306(mysql) gid=3306(mysql) groups=3306(mysql)
2、安装并初始化MySQL
node1
[root@node1 ~]# tar xf mysql-5.5.28-linux2.6-x86_64.tar.gz -C /usr/local/ [root@node1 ~]# cd /usr/local/ [root@node1 local]# ln -sv mysql-5.5.28-linux2.6-x86_64 mysql create symbolic link `mysql' to `mysql-5.5.28-linux2.6-x86_64' [root@node1 local]# cd mysql [root@node1 mysql]# chown -R root.mysql ./* [root@node1 mysql]# ll total 132 drwxr-xr-x 2 root mysql 4096 Jan 10 12:01 bin -rw-r--r-- 1 root mysql 17987 Aug 29 2012 COPYING drwxr-xr-x 4 root mysql 4096 Jan 10 12:01 data drwxr-xr-x 2 root mysql 4096 Jan 10 12:01 docs drwxr-xr-x 3 root mysql 4096 Jan 10 12:01 include -rw-r--r-- 1 root mysql 7604 Aug 29 2012 INSTALL-BINARY drwxr-xr-x 3 root mysql 4096 Jan 10 12:01 lib drwxr-xr-x 4 root mysql 4096 Jan 10 12:02 man drwxr-xr-x 10 root mysql 4096 Jan 10 12:02 mysql-test -rw-r--r-- 1 root mysql 2552 Aug 29 2012 README drwxr-xr-x 2 root mysql 4096 Jan 10 12:02 scripts drwxr-xr-x 27 root mysql 4096 Jan 10 12:01 share drwxr-xr-x 4 root mysql 4096 Jan 10 12:02 sql-bench drwxr-xr-x 2 root mysql 4096 Jan 10 12:02 support-files 准备数据目录，请确保此时/dev/drbd0设备已挂载 node1 [root@node1 ~]# mkdir /mydata/data [root@node1 ~]# chown -R mysql.mysql /mydata/data [root@node1 mysql]# ll -d /mydata/data drwxr-xr-x 2 mysql mysql 4096 Jan 10 12:04 /mydata/data 此时再在node1上初始化mysql [root@node1 mysql]# scripts/mysql_install_db --user=mysql --datadir=/mydata/data Installing MySQL system tables... OK Filling help tables... OK To start mysqld at boot time you have to copy support-files/mysql.server to the right place for your system PLEASE REMEMBER TO SET A PASSWORD FOR THE MySQL root USER ! To do so, start the server, then issue the following commands: ./bin/mysqladmin -u root password 'new-password' ./bin/mysqladmin -u root -h node1.network.com password 'new-password' Alternatively you can run: ./bin/mysql_secure_installation which will also give you the option of removing the test databases and anonymous user created by default. This is strongly recommended for production servers. See the manual for more instructions. You can start the MySQL daemon with: cd . ; ./bin/mysqld_safe & You can test the MySQL daemon with mysql-test-run.pl cd ./mysql-test ; perl mysql-test-run.pl Please report any problems with the ./bin/mysqlbug script! [root@node1 mysql]# ll /mydata/data/ total 24 drwx------ 2 mysql root 4096 Jan 10 12:05 mysql drwx------ 2 mysql mysql 4096 Jan 10 12:05 performance_schema drwx------ 2 mysql root 4096 Jan 10 12:05 test 拷贝配置文件和服务脚本 [root@node1 mysql]# cp support-files/my-large.cnf /etc/my.cnf [root@node1 mysql]# cp support-files/mysql.server /etc/rc.d/init.d/mysqld 修改mysql的配置文件 [root@node1 mysql]# vim /etc/my.cnf [root@node1 mysql]# grep -A 1 "datadir" /etc/my.cnf datadir = /mydata/data innodb_file_per_table = 1 将两文件拷贝至node2 [root@node1 ~]# scp /etc/rc.d/init.d/mysqld node2:/etc/rc.d/init.d/ mysqld 100% 10KB 10.4KB/s 00:00 [root@node1 ~]# scp /etc/my.cnf node2:/etc/ my.cnf 100% 4713 4.6KB/s 00:00
node2
[root@node2 ~]# tar xf mysql-5.5.28-linux2.6-x86_64.tar.gz -C /usr/local/ [root@node2 ~]# cd /usr/local/ [root@node2 local]# ln -sv mysql-5.5.28-linux2.6-x86_64 mysql create symbolic link `mysql' to `mysql-5.5.28-linux2.6-x86_64' [root@node2 local]# cd mysql [root@node2 mysql]# chown -R root.mysql ./* [root@node2 mysql]# ll total 132 drwxr-xr-x 2 root mysql 4096 Jan 7 19:31 bin -rw-r--r-- 1 root mysql 17987 Aug 29 2012 COPYING drwxr-xr-x 4 root mysql 4096 Jan 7 19:31 data drwxr-xr-x 2 root mysql 4096 Jan 7 19:30 docs drwxr-xr-x 3 root mysql 4096 Jan 7 19:31 include -rw-r--r-- 1 root mysql 7604 Aug 29 2012 INSTALL-BINARY drwxr-xr-x 3 root mysql 4096 Jan 7 19:31 lib drwxr-xr-x 4 root mysql 4096 Jan 7 19:31 man drwxr-xr-x 10 root mysql 4096 Jan 7 19:31 mysql-test -rw-r--r-- 1 root mysql 2552 Aug 29 2012 README drwxr-xr-x 2 root mysql 4096 Jan 7 19:31 scripts drwxr-xr-x 27 root mysql 4096 Jan 7 19:31 share drwxr-xr-x 4 root mysql 4096 Jan 7 19:31 sql-bench drwxr-xr-x 2 root mysql 4096 Jan 7 19:31 support-files 在node1节点上已经初始化过了，所以这里不需要再初始化
3、测试mysql的数据目录是否会同步
[root@node1 mysql]# service mysqld start Starting MySQL..... [ OK ] [root@node1 mysql]# /usr/local/mysql/bin/mysql Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 1 Server version: 5.5.28-log MySQL Community Server (GPL) Type 'help;' or '\h' for help. Type '\c' to clear the buffer. mysql> SHOW DATABASES; +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | performance_schema | | test | +--------------------+ 4 rows in set (0.13 sec) mysql> CREATE DATABASE mydb; # 创建个测试库 Query OK, 1 row affected (0.00 sec) mysql> \q Bye [root@node1 mysql]# service mysqld stop Shutting down MySQL. [ OK ] 卸载目录，并降级为备从点 [root@node1 mysql]# umount /dev/drbd0 [root@node1 mysql]# drbdadm secondary mysql 再将node2提升为主节点，并挂载数据目录，看能否看到刚才创建的测试库 [root@node2 mysql]# drbdadm primary mysql [root@node2 mysql]# mount /dev/drbd0 /mydata/ 启动mysql [root@node2 mysql]# service mysqld start Starting MySQL... [ OK ] [root@node2 mysql]# /usr/local/mysql/bin/mysql Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 1 Server version: 5.5.28-log MySQL Community Server (GPL) Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> SHOW DATABASES; +--------------------+ | Database | +--------------------+ | information_schema | | mydb | | mysql | | performance_schema | | test | +--------------------+ 5 rows in set (0.07 sec) mysql> DROP DATABASE mydb; # 确实可以实现数据同步，现在删除这个测试库 Query OK, 0 rows affected (0.04 sec) mysql> \q Bye 将drbd设备作为mysql的数据目录是可行的，已经测试完毕，接下来就可以配置corosync和pacemaker了，在这之前 还有一个操作作为高可用服务，资源一定不能开机自启动，所以这里我们关闭两个节点上的drbd和mysql自启动 node2 [root@node2 ~]# service mysqld stop Shutting down MySQL. [ OK ] [root@node2 ~]# chkconfig mysqld off [root@node2 ~]# service drbd stop Stopping all DRBD resources: . [root@node2 ~]# chkconfig drbd off 因为node1在刚才的测试中是从节点，所以node1上的mysqld服务都是关闭的 [root@node1 mysql]# chkconfig mysqld off [root@node1 mysql]# service drbd stop Stopping all DRBD resources: . [root@node1 mysql]# chkconfig drbd off 接下来开始配置corosync
五、corosync的安装与基本配置
1、配置yum源(也可以自行下载两个软件包，我这里直接使用yum源)
node1
[root@node1 ~]# cd /etc/yum.repos.d/ [root@node1 yum.repos.d]# wget http://clusterlabs.org/rpm/epel-5/clusterlabs.repo [root@node1 yum.repos.d]# yum install -y pacemaker corosync
node2
[root@node2 ~]# cd /etc/yum.repos.d/ [root@node2 yum.repos.d]# wget http://clusterlabs.org/rpm/epel-5/clusterlabs.repo [root@node2 yum.repos.d]# yum install -y pacemaker corosync
2、编辑corosync的主配置文件
[root@node1 ~]# cd /etc/corosync/
[root@node1 corosync]# ls
corosync.conf.example service.d uidgid.d
[root@node1 corosync]# cp corosync.conf.example corosync.conf
[root@node1 corosync]# vi corosync.conf
# Please read the corosync.conf.5 manual page
compatibility: whitetank
totem {
version: 2 # 配置文件版本号，目前合法的版本号是2，不能修改
secauth: on # 开启安全认证功能，当使用aisexec时，会非常消耗CPU
threads: 2 # 线程数，根据CPU个数和核心数确定
interface {
ringnumber: 0 # 冗余环号，节点有多个网卡是可定义对应网卡在一个环内
bindnetaddr: 172.16.1.0 # 注意，这里填的是网络地址，不是某个ip
mcastaddr: 226.94.19.37 # 心跳信息传递的组播地址
mcastport: 5405 # 心跳信息组播使用端口
}
}
logging {
fileline: off # 指定要打印的行
to_stderr: no # 是否发送到标准错误输出，即显示器，建议不要开启
to_logfile: yes # 定义是否记录到日志文件
to_syslog: no # 定义是否记录到syslog，与logfile只启用一个即可
logfile: /var/log/cluster/corosync.log # 定义日志文件的保存位置
debug: off # 是否开启debug功能
timestamp: on # 是否打印时间戳，利于定位错误，但会消耗CPU
logger_subsys {
subsys: AMF
debug: off
}
}
service {
ver: 0
name: pacemaker # 定义pacemaker作为corosync的插件运行，启动sync时则会同时启动pacemaker
# use_mgmtd: yes
}
aisexec {
user: root
group: root
}
amf {
mode: disabled
}
注：各指令详细信息可man corosync.conf
3、生成authkey文件
[root@node1 corosync]# corosync-keygen Corosync Cluster Engine Authentication key generator. Gathering 1024 bits for key from /dev/random. Press keys on your keyboard to generate entropy. Writing corosync key to /etc/corosync/authkey. [root@node1 corosync]# ll total 40 -r-------- 1 root root 128 Jan 8 14:50 authkey # 权限为400 -rw-r--r-- 1 root root 536 Jan 8 14:48 corosync.conf -rw-r--r-- 1 root root 436 Jul 28 2010 corosync.conf.example drwxr-xr-x 2 root root 4096 Jul 28 2010 service.d drwxr-xr-x 2 root root 4096 Jul 28 2010 uidgid.d
4、将主配置文件和密钥认证文件拷贝至node2节点
[root@node1 corosync]# scp -p authkey corosync.conf node2:/etc/corosync/ authkey 100% 128 0.1KB/s 00:00 corosync.conf 100% 536 0.5KB/s 00:00 由于我们定义了记录到日志文件中，所以此处还得创建那个日志目录 [root@node1 corosync]# mkdir /var/log/cluster [root@node1 corosync]# ssh node2 'mkdir /var/log/cluster'
5、启动corosync
首先启动corosync，再查看启动过程信息，这里以node1为例
[root@node1 ~]# service corosync start
Starting Corosync Cluster Engine (corosync): [ OK ]
[root@node1 ~]# ssh node2 'service corosync start'
Starting Corosync Cluster Engine (corosync): [ OK ]
查看corosync引擎是否正常启动
[root@node1 corosync]# grep -e "Corosync Cluster Engine" -e "configuration file" /var/log/cluster/corosync.log
Jan 08 15:37:22 corosync [MAIN ] Corosync Cluster Engine ('1.2.7'): started and ready to provide service.
Jan 08 15:37:22 corosync [MAIN ] Successfully read main configuration file '/etc/corosync/corosync.conf'.
查看初始化成员节点通知是否正常发出
[root@node1 corosync]# grep TOTEM /var/log/cluster/corosync.log
Jan 08 15:37:22 corosync [TOTEM ] Initializing transport (UDP/IP).
Jan 08 15:37:22 corosync [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
Jan 08 15:37:22 corosync [TOTEM ] The network interface [172.16.1.101] is now up.
Jan 08 15:37:22 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.
Jan 08 15:37:30 corosync [TOTEM ] A processor joined or left the membership and a new membership was formed.
检查启动过程中是否有错误产生
[root@node1 corosync]# grep ERROR: /var/log/cluster/corosync.log
Jan 08 15:37:46 node1.network.com pengine: [3688]: ERROR: unpack_resources: Resource start-up disabled since no STONITH resources have been defined
Jan 08 15:37:46 node1.network.com pengine: [3688]: ERROR: unpack_resources: Either configure some or disable STONITH with the stonith-enabled option
Jan 08 15:37:46 node1.network.com pengine: [3688]: ERROR: unpack_resources: NOTE: Clusters with shared data need STONITH to ensure data integrity
查看pacemaker是否正常启动
[root@node1 corosync]# grep pcmk_startup /var/log/cluster/corosync.log
Jan 08 15:37:22 corosync [pcmk ] info: pcmk_startup: CRM: Initialized
Jan 08 15:37:22 corosync [pcmk ] Logging: Initialized pcmk_startup
Jan 08 15:37:22 corosync [pcmk ] info: pcmk_startup: Maximum core file size is: 18446744073709551615
Jan 08 15:37:22 corosync [pcmk ] info: pcmk_startup: Service: 9
Jan 08 15:37:22 corosync [pcmk ] info: pcmk_startup: Local hostname: node1.network.com
查看集群节点状态
[root@node1 ~]# crm status
============
Last updated: Fri Jan 8 18:32:18 2016
Stack: openais
Current DC: node1.network.com - partition with quorum
Version: 1.0.12-unknown
2 Nodes configured, 2 expected votes
0 Resources configured.
============
Online: [ node1.network.com node2.network.com ]
6、配置资源的默认属性
随便哪个节点上运行crm都可以，会自动同步操作至DC [root@node1 ~]# crm crm(live)# status ============ Last updated: Fri Jan 8 19:48:51 2016 Stack: openais Current DC: node2.network.com - partition with quorum Version: 1.0.12-unknown 2 Nodes configured, 2 expected votes 0 Resources configured. ============ Online: [ node1.network.com node2.network.com ] crm(live)# configure crm(live)configure# verify crm_verify[10513]: 2016/01/08_19:48:54 ERROR: unpack_resources: Resource start-up disabled since no STONITH resources have been defined crm_verify[10513]: 2016/01/08_19:48:54 ERROR: unpack_resources: Either configure some or disable STONITH with the stonith-enabled option crm_verify[10513]: 2016/01/08_19:48:54 ERROR: unpack_resources: NOTE: Clusters with shared data need STONITH to ensure data integrity Errors found during check: config not valid crm(live)configure# property stonith-enabled=false # 禁用stonith设备 crm(live)configure# property no-quorum-policy=ignore # 不具备法定票数时采取的动作 crm(live)configure# rsc_defaults target-role=stopped # 配置资源完成之后默认采取的动作 crm(live)configure# rsc_defaults resource-stickiness=100 # 设置默认的资源黏性 crm(live)configure# verify crm(live)configure# commit 查看配置文件中生成的定义 crm(live)configure# show node node1.network.com node node2.network.com property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100"
六、基于crm配置资源
1、定义drbd主从资源
首先定义一个主资源 crm(live)configure# primitive mysqldrbd ocf:heartbeat:drbd params drbd_resource=mysql ignore_deprecation=true op start timeout=240s op stop timeout=100s op monitor role=Master interval=10s timeout=20s op monitor role=Slave interval=20s timeout=20s crm(live)configure# verify 再将此主资源定义为主从资源 crm(live)configure# ms ms_mysqldrbd mysqldrbd meta master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true crm(live)configure# verify crm(live)configure# commit 查看配置信息 crm(live)configure# show node node1.network.com node node2.network.com primitive mysqldrbd ocf:heartbeat:drbd \ params drbd_resource="mysql" ignore_deprecation="true" \ op start interval="0" timeout="240s" \ op stop interval="0" timeout="100s" \ op monitor interval="10s" role="Master" timeout="20s" \ op monitor interval="20s" role="Slave" timeout="20s" ms ms_mysqldrbd mysqldrbd \ meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100"
2、定义mysqlstore资源
crm(live)configure# primitive mysqlstore ocf:heartbeat:Filesystem params device=/dev/drbd0 directory=/mydata fstype=ext3 op start timeout=60s op stop timeout=60s crm(live)configure# verify crm(live)configure# commit 查看配置信息 crm(live)configure# show node node1.network.com node node2.network.com primitive mysqldrbd ocf:heartbeat:drbd \ params drbd_resource="mysql" ignore_deprecation="true" \ op start interval="0" timeout="240s" \ op stop interval="0" timeout="100s" \ op monitor interval="10s" role="Master" timeout="20s" \ op monitor interval="20s" role="Slave" timeout="20s" primitive mysqlstore ocf:heartbeat:Filesystem \ params device="/dev/drbd0" directory="/mydata" fstype="ext3" \ op start interval="0" timeout="60s" \ op stop interval="0" timeout="60s" ms ms_mysqldrbd mysqldrbd \ meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100"
3、定义mysqld资源
crm(live)configure# primitive mysqld lsb:mysqld crm(live)configure# verify 查看配置信息 crm(live)configure# show node node1.network.com node node2.network.com primitive mysqld lsb:mysqld primitive mysqldrbd ocf:heartbeat:drbd \ params drbd_resource="mysql" ignore_deprecation="true" \ op start interval="0" timeout="240s" \ op stop interval="0" timeout="100s" \ op monitor interval="10s" role="Master" timeout="20s" \ op monitor interval="20s" role="Slave" timeout="20s" primitive mysqlstore ocf:heartbeat:Filesystem \ params device="/dev/drbd0" directory="/mydata" fstype="ext3" \ op start interval="0" timeout="60s" \ op stop interval="0" timeout="60s" ms ms_mysqldrbd mysqldrbd \ meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100"
4、定义mysqlip资源
crm(live)configure# primitive mysqlip ocf:heartbeat:IPaddr params ip=172.16.1.110 cidr_netmask=16 nic=eth0 crm(live)configure# verify crm(live)configure# commit 查看配置信息 crm(live)configure# show node node1.network.com node node2.network.com primitive mysqld lsb:mysqld primitive mysqldrbd ocf:heartbeat:drbd \ params drbd_resource="mysql" ignore_deprecation="true" \ op start interval="0" timeout="240s" \ op stop interval="0" timeout="100s" \ op monitor interval="10s" role="Master" timeout="20s" \ op monitor interval="20s" role="Slave" timeout="20s" primitive mysqlip ocf:heartbeat:IPaddr \ params ip="172.16.1.110" cidr_netmask="16" nic="eth0" primitive mysqlstore ocf:heartbeat:Filesystem \ params device="/dev/drbd0" directory="/mydata" fstype="ext3" \ op start interval="0" timeout="60s" \ op stop interval="0" timeout="60s" ms ms_mysqldrbd mysqldrbd \ meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100"
5、定义mysqlservice组资源
crm(live)configure# group mysqlservice mysqlstore mysqlip mysqld crm(live)configure# verify crm(live)configure# commit 查看配置信息 crm(live)configure# show node node1.network.com node node2.network.com primitive mysqld lsb:mysqld primitive mysqldrbd ocf:heartbeat:drbd \ params drbd_resource="mysql" ignore_deprecation="true" \ op start interval="0" timeout="240s" \ op stop interval="0" timeout="100s" \ op monitor interval="10s" role="Master" timeout="20s" \ op monitor interval="20s" role="Slave" timeout="20s" primitive mysqlip ocf:heartbeat:IPaddr \ params ip="172.16.1.110" cidr_netmask="16" nic="eth0" primitive mysqlstore ocf:heartbeat:Filesystem \ params device="/dev/drbd0" directory="/mydata" fstype="ext3" \ op start interval="0" timeout="60s" \ op stop interval="0" timeout="60s" group mysqlservice mysqlstore mysqlip mysqld ms ms_mysqldrbd mysqldrbd \ meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100"
6、定义排列约束
由于我们定义了一个组资源mysqlservice，所以mysqlstore、mysqlip、mysqld一定是允许在同一个节点的 所以我们只需要将主从资源中的主资源ms_mysqldrbd与这个组定义为排列约束即可 crm(live)configure# colocation mysqlservice_with_ms_mysqldrbd inf: mysqlservice ms_mysqldrbd:Master crm(live)configure# verify crm(live)configure# commit 查看配置信息 crm(live)configure# show node node1.network.com node node2.network.com primitive mysqld lsb:mysqld primitive mysqldrbd ocf:heartbeat:drbd \ params drbd_resource="mysql" ignore_deprecation="true" \ op start interval="0" timeout="240s" \ op stop interval="0" timeout="100s" \ op monitor interval="10s" role="Master" timeout="20s" \ op monitor interval="20s" role="Slave" timeout="20s" primitive mysqlip ocf:heartbeat:IPaddr \ params ip="172.16.1.110" cidr_netmask="16" nic="eth0" primitive mysqlstore ocf:heartbeat:Filesystem \ params device="/dev/drbd0" directory="/mydata" fstype="ext3" \ op start interval="0" timeout="60s" \ op stop interval="0" timeout="60s" group mysqlservice mysqlstore mysqlip mysqld ms ms_mysqldrbd mysqldrbd \ meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" colocation mysqlservice_with_ms_mysqldrbd inf: mysqlservice ms_mysqldrbd:Master property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100"
7、定义顺序约束
定义顺序约束，先启动ms_mysqldrbd，再启动mysqlservice组资源 crm(live)configure# order ms_mysqldrbd_before_mysqlservice mandatory: ms_mysqldrbd:promote mysqlservice:start crm(live)configure# verify crm(live)configure# commit 查看配置信息 crm(live)configure# show node node1.network.com node node2.network.com primitive mysqld lsb:mysqld primitive mysqldrbd ocf:heartbeat:drbd \ params drbd_resource="mysql" ignore_deprecation="true" \ op start interval="0" timeout="240s" \ op stop interval="0" timeout="100s" \ op monitor interval="10s" role="Master" timeout="20s" \ op monitor interval="20s" role="Slave" timeout="20s" primitive mysqlip ocf:heartbeat:IPaddr \ params ip="172.16.1.110" cidr_netmask="16" nic="eth0" primitive mysqlstore ocf:heartbeat:Filesystem \ params device="/dev/drbd0" directory="/mydata" fstype="ext3" \ op start interval="0" timeout="60s" \ op stop interval="0" timeout="60s" group mysqlservice mysqlstore mysqlip mysqld ms ms_mysqldrbd mysqldrbd \ meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" colocation mysqlservice_with_ms_mysqldrbd inf: mysqlservice ms_mysqldrbd:Master order ms_mysqldrbd_before_mysqlservice inf: ms_mysqldrbd:promote mysqlservice:start property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100" 定义顺序约束，对于mysqlservice组资源，先启动mysqlstore，再启动mysqlip，再启动mysqld服务 crm(live)configure# order mysqlstore_before_mysqlip_before_mysqld mandatory: mysqlstore mysqlip mysqld crm(live)configure# verify crm(live)configure# commit 查看配置信息 crm(live)configure# show node node1.network.com node node2.network.com primitive mysqld lsb:mysqld primitive mysqldrbd ocf:heartbeat:drbd \ params drbd_resource="mysql" ignore_deprecation="true" \ op start interval="0" timeout="240s" \ op stop interval="0" timeout="100s" \ op monitor interval="10s" role="Master" timeout="20s" \ op monitor interval="20s" role="Slave" timeout="20s" primitive mysqlip ocf:heartbeat:IPaddr \ params ip="172.16.1.110" cidr_netmask="16" nic="eth0" primitive mysqlstore ocf:heartbeat:Filesystem \ params device="/dev/drbd0" directory="/mydata" fstype="ext3" \ op start interval="0" timeout="60s" \ op stop interval="0" timeout="60s" group mysqlservice mysqlstore mysqlip mysqld ms ms_mysqldrbd mysqldrbd \ meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true" colocation mysqlservice_with_ms_mysqldrbd inf: mysqlservice ms_mysqldrbd:Master order ms_mysqldrbd_before_mysqlservice inf: ms_mysqldrbd:promote mysqlservice:start order mysqlstore_before_mysqlip_before_mysqld inf: mysqlstore mysqlip mysqld property $id="cib-bootstrap-options" \ dc-version="1.0.12-unknown" \ cluster-infrastructure="openais" \ expected-quorum-votes="2" \ stonith-enabled="false" \ no-quorum-policy="ignore" rsc_defaults $id="rsc-options" \ target-role="stopped" \ resource-stickiness="100"
8、启动配置好的资源
crm(live)configure# cd crm(live)# resource 启动ms_mysqldrbd主从资源 crm(live)resource# start ms_mysqldrbd 启动mysqlservice组资源 crm(live)resource# start mysqlservice crm(live)resource# cd 查看运行状态 crm(live)# status ============ Last updated: Sun Jan 10 13:37:14 2016 Stack: openais Current DC: node2.network.com - partition with quorum Version: 1.0.12-unknown 2 Nodes configured, 2 expected votes 2 Resources configured. ============ Online: [ node1.network.com node2.network.com ] Master/Slave Set: ms_mysqldrbd Masters: [ node1.network.com ] Slaves: [ node2.network.com ] Resource Group: mysqlservice mysqlstore (ocf::heartbeat:Filesystem): Started node1.network.com mysqlip (ocf::heartbeat:IPaddr): Started node1.network.com mysqld (lsb:mysqld): Started node1.network.com 再来查看下drbd的主从节点 [root@node1 ~]# drbd-overview 0:mysql Connected Primary/Secondary UpToDate/UpToDate C r----- /mydata ext3 940M 47M 845M 6% 查看是否挂载drbd设备 [root@node1 ~]# mount | tail -1 /dev/drbd0 on /mydata type ext3 (rw) 查看mysqlip是否启用 [root@node1 ~]# ip addr show | grep "172.16.1.110" inet 172.16.1.110/16 brd 172.16.255.255 scope global eth0:0 查看mysqld服务是否启动 [root@node1 ~]# ss -tnl | grep "3306" 0 0 *:3306 *:*
9、测试高可用性
此时资源是运行在node1节点上的 [root@node1 ~]# crm crm(live)# status ============ Last updated: Sun Jan 10 13:42:33 2016 Stack: openais Current DC: node2.network.com - partition with quorum Version: 1.0.12-unknown 2 Nodes configured, 2 expected votes 2 Resources configured. ============ Online: [ node1.network.com node2.network.com ] Master/Slave Set: ms_mysqldrbd Masters: [ node1.network.com ] Slaves: [ node2.network.com ] Resource Group: mysqlservice mysqlstore (ocf::heartbeat:Filesystem): Started node1.network.com mysqlip (ocf::heartbeat:IPaddr): Started node1.network.com mysqld (lsb:mysqld): Started node1.network.com 让node1节点下线，看资源是否会自动转移 crm(live)# node standby node1.network.com 查看运行状态 crm(live)# status ============ Last updated: Sun Jan 10 13:44:09 2016 Stack: openais Current DC: node2.network.com - partition with quorum Version: 1.0.12-unknown 2 Nodes configured, 2 expected votes 2 Resources configured. ============ Node node1.network.com: standby Online: [ node2.network.com ] Master/Slave Set: ms_mysqldrbd Masters: [ node2.network.com ] Stopped: [ mysqldrbd:0 ] Resource Group: mysqlservice mysqlstore (ocf::heartbeat:Filesystem): Started node2.network.com mysqlip (ocf::heartbeat:IPaddr): Started node2.network.com mysqld (lsb:mysqld): Started node2.network.com 可以看到已成功转移，node2已经挂载了drbd设备 再让node1节点上线，发现资源并不会转移，因为我们定义了资源黏性为100 crm(live)# node online node1.network.com crm(live)# status ============ Last updated: Sun Jan 10 13:45:26 2016 Stack: openais Current DC: node2.network.com - partition with quorum Version: 1.0.12-unknown 2 Nodes configured, 2 expected votes 2 Resources configured. ============ Online: [ node1.network.com node2.network.com ] Master/Slave Set: ms_mysqldrbd Masters: [ node2.network.com ] Slaves: [ node1.network.com ] Resource Group: mysqlservice mysqlstore (ocf::heartbeat:Filesystem): Started node2.network.com mysqlip (ocf::heartbeat:IPaddr): Started node2.network.com mysqld (lsb:mysqld): Started node2.network.com
10、测试远程访问mysql
可以看到此时资源是运行在node2节点上的 [root@node2 ~]# crm status ============ Last updated: Sun Jan 10 13:49:48 2016 Stack: openais Current DC: node2.network.com - partition with quorum Version: 1.0.12-unknown 2 Nodes configured, 2 expected votes 2 Resources configured. ============ Online: [ node1.network.com node2.network.com ] Master/Slave Set: ms_mysqldrbd Masters: [ node2.network.com ] Slaves: [ node1.network.com ] Resource Group: mysqlservice mysqlstore (ocf::heartbeat:Filesystem): Started node2.network.com mysqlip (ocf::heartbeat:IPaddr): Started node2.network.com mysqld (lsb:mysqld): Started node2.network.com 现在在node2节点上直接连上mysql，然后给mysql授权允许远程访问 [root@node2 ~]# /usr/local/mysql/bin/mysql Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 2 Server version: 5.5.28-log MySQL Community Server (GPL) Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'redhat'; Query OK, 0 rows affected (0.07 sec) mysql> FLUSH PRIVILEGES; Query OK, 0 rows affected (0.00 sec) mysql> SHOW DATABASES; +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | performance_schema | | test | +--------------------+ 4 rows in set (0.11 sec) mysql> CREATE DATABASE mydb; # 创建个测试库，看等下主从切换时，另外个节点能否访问 Query OK, 1 row affected (0.13 sec) mysql> \q Bye 现在我们切换至node1，并让node2成为从节点 [root@node1 ~]# crm node standby node2.network.com [root@node1 ~]# crm node online node2.network.com [root@node1 ~]# crm status ============ Last updated: Sun Jan 10 13:55:37 2016 Stack: openais Current DC: node2.network.com - partition with quorum Version: 1.0.12-unknown 2 Nodes configured, 2 expected votes 2 Resources configured. ============ Online: [ node1.network.com node2.network.com ] Master/Slave Set: ms_mysqldrbd Masters: [ node1.network.com ] Slaves: [ node2.network.com ] Resource Group: mysqlservice mysqlstore (ocf::heartbeat:Filesystem): Started node1.network.com mysqlip (ocf::heartbeat:IPaddr): Started node1.network.com mysqld (lsb:mysqld): Started node1.network.com 谁用tcp协议连接mysql，看是否能访问到刚才创建的测试库 [root@node1 ~]# /usr/local/mysql/bin/mysql -uroot -h 172.16.1.110 -p Enter password: Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 1 Server version: 5.5.28-log MySQL Community Server (GPL) Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> SHOW DATABASES; +--------------------+ | Database | +--------------------+ | information_schema | | mydb | | mysql | | performance_schema | | test | +--------------------+ 5 rows in set (0.17 sec) mysql> DROP DATABASE mydb; # 测试成功，删除此测试库 Query OK, 0 rows affected (0.25 sec) mysql> \q Bye
到此，一个 Corosync + Pacemaker + DRBD + mysql的高可用解决方案配置完成