Linux LVS+Heartbeat+memcached+nfs Web集群的构建

经过几天的学习与折腾，终于搞定了 LVS+Heartbeat+memcached+nfs,时间主要花在ldirectord上了。把安装与配置记录下来，以防日后遗忘，也方便他人学 习。以下配置在CentOS5.1下测试通过的，如果没有笔误，应该没有什么问题。 一、说明 LVS 是Linux Virtual Server，主要用来实现后端服务的负载均衡，用源码包ipvsadm构建，本文使用基于tunneling模式的转发机制，调度算法使用 weighted Least-connec

 经过几天的学习与折腾，终于搞定了LVS+Heartbeat+memcached+nfs,时间主要花在ldirectord上了。把安装与配置记录下来，以防日后遗忘，也方便他人学习。以下配置在CentOS5.1下测试通过的，如果没有笔误，应该没有什么问题。

一、说明

LVS 是Linux Virtual Server，主要用来实现后端服务的负载均衡，用源码包ipvsadm构建，本文使用基于tunneling模式的转发机制，调度算法使用 weighted Least-connected(wlc),即每个新的连接被分配到负担最小的服务器。

Heartbeat 是一种心跳检测机制，主要用来实现双机互备份，它的接管工作是通过ARP欺骗的手段来完成的。

Memcached memcached不是memcache,它是高性能的，分布式的内存对象缓存系统，用于在动态应用中减少数据库负载，提升访问速度。在本文主要用来实现session共享。

NFS 在本文用来实现web源程序目录挂载到web服务器的本地目录

1．拓扑图

 

 

 

 

2．服务器主机名与IP分配

VIP:192.168.1.10

Virtual Server

主机名:lvs1

Eth0_IP:192.168.1.2/24

Eth1_IP:192.168.10.9/29(heartbeat line)

Virtual Server_backup

主机名:lvs2

Eth0_IP:192.168.1.3/24

Eth1_IP:192.168.10.10/29(heartbeat line)

Real Server web1

主机名:web1

IP:192.168.1.4/24

Real Server web2

主机名:web2

IP:192.168.1.5/24

Memcached and web code

主机名:share

IP:192.168.1.6/24

Mysql server

主机名：data

IP:192.168.1.7/24

 

二、安装与配置LVS

1.安装 ipvsadm

# tar zxvf ipvsadm-1.24.tar

# cd ipvsadm-1.24

# ln –s /usr/src/kernels/2.6.18-53.el5-i686/ /usr/src/linux

# make

# make install

2. Configure shell of tunlvs on Vritual Server and Vritual server_backup

 

 

# vi /etc/rc.d/init.d/tunlvs

#!/bin/sh

VIP=192.168.1.10

WEB1=192.168.1.4

WEB2=192.168.1.5

/etc/rc.d/init.d/functions

case "$1" in

start)

echo "start LVS directorserver"

/sbin/ifconfig tunl0 $VIP broadcast $VIP netmask 255.255.255.255 up

/sbin/route add -host $VIP dev tunl0

/sbin/ipvsadm -C

/sbin/ipvsadm -A -t $VIP:80 -s wlc

/sbin/ipvsadm -a -t $VIP:80 -r $WEB1:80 -i

/sbin/ipvsadm -a -t $VIP:80 -r $WEB2:80 -i

/sbin/ipvsadm

;;

stop)

echo "close LVS directorserver"

/sbin/ipvsadm -C

;;

*)

echo "Usage:$0 {start|stop}"

exit 1

esac

 

# chmod 755 /etc/rc.d/init.d/tunlvs

 

3、Configure shell of tunl on Real_web1 and Real_web2

 

 

# vi /etc/rc.d/init.d/tunl

#!/bin/sh

VIP=192.168.1.10

/etc/rc.d/init.d/functions

case "$1" in

start)

echo "tunl port starting"

/sbin/ifconfig tunl0 $VIP broadcast $VIP netmask 255.255.255.255 up

/sbin/ifconfig add -host $VIP dev tunl0

echo "1">/proc/sys/net/ipv4/conf/tunl0/arp_ignore

echo "2">/proc/sys/net/ipv4/conf/tunl0/arp_announce

echo "1">/proc/sys/net/ipv4/conf/all/arp_ignore

echo "2">/proc/sys/net/ipv4/conf/all/arp_announce

sysctl –p

;;

stop)

echo "tunl port closing"

ifconfig tunl0 down

echo "1">/proc/sys/net/ipv4/ip_forward

echo "0">/proc/sys/net/ipv4/conf/all/arp_announce

;;

*)

echo "Usege:$0 {start|stop}"

exit 1

esac

 

4、test lvs

 

Virtual Server：

 

# /etc/rc.d/init.d/tunlvs start

 

Real_web1 and Real_web2：

 

# /etc/rc.d/init.d/tunl start

 

Real_web1:

 

# echo “this is test for web1”>>/var/www/html/index.html

 

Real_web2:

# echo “this is test for web2”>>/var/www/html/index.html

 

 

五、NFS与Memcached(Session共享)

1．Nfs

# rpm -ivh /mnt/CentOS/portmap-4.0-65.2.2.1.i386.rpm

# rpm -ivh /mnt/CentOS/nfs-utils-1.0.9-24.el5.i386.rpm

# vi /etc/exports

/webdata 192.168.1.4(rw,sync,no_wdelay) 192.168.1.5(rw,sync,no_wdelay)

# chkconfig –level 35 portmap on

# chkconfig –level 35 nfs on

# /etc/rc.d/init.d/portmap start

# /etc/rc.d/init.d/nfs start

2.Memcached

# rpm –ivh /mnt/Centos/ libevent-1.1a-3.2.1.i386.rpm

# rpm –ivh /mnt/Centos/ libevent-devel-1.1a-3.2.1.i386.rpm

# tar zxvf memcached-1.2.6.tar.tar

# ./configure

# make && make install

# memcached -d -m 512 –l 192.168.1.6 -p 11211 -u root

# killall –HUP memcached

六、挂载 web主目录与配置php使用session共享

Real_web1 and Real_web2

1．mount

# showmount –e 192.168.1.6

# mount –t nfs 192.168.1.6:/webdata /var/www/html

# vi /etc/fstab

192.168.1.6:/webdata /var/www/html nfs defaults 0 0

2. 配置php使用session共享

# tar zxvf memcache-2.2.3.tgz

# phpize

# ./configure –enable-memcache

# make && make install

# vi /etc/php.ini

[Session]

extension=memcache.so

extension_dir = "/usr/lib/php/modules"

session.save_handler = memcache
session.save_path = “tcp://192.168.1.6:11211”

七、监控页的设置

Real_web1 and Real_web2:

这里是配合ldirectord.cf的ldirectord守护进程

# mkdir /var/www/test

# vi /etc/httpd/conf/httpd.conf

Alias /test/ "/var/www/test/"

<Directory "/var/www/test/">

    Options FollowSymLinks

    AllowOverride None

    Order allow,deny

    Allow from all

</Directory>

# echo "Test Page" > /var/www/test/test.html

八、Mysql Server

# /etc/rc.d/init.d/mysqld start

# mysqladmin -u root -p password test

# mysql –root –p

> grant all on *.* to mysql@’192.168.1.0/24’ identified by ‘your_password ’with grant option;

> flush privileges;                    

> quit;