安装Ganglia监控hadoop

Ganglia安装
安装Ganglia监控hadoop
yum -y install httpd-devel automake autoconf libtool ncurses-devel libxslt groff pcre-devel pkgconfig
安装ganglia-gmetad 和 ganglia-web
yum search ganglia
yum -y install ganglia-web.x86_64 ganglia-gmond.x86_64 
rpm -qa |grep ganglia          --------------------查看安装情况  
rpm -ql ganglia-web-3.1.7-6.el6.x86_64     ------------- 复制上面命令执行结果的安装名,可查看安装路径 
配置gmetad  
vi /etc/ganglia/gmond.conf
cluster {
  name = "hadoop-cluster"         #集群名称
  owner = "ganglia"               #运行Ganglia的用户
  latlong = "unspecified"
  url = "unspecified"
} 
udp_send_channel {
  mcast_join = 239.2.11.71     
  host = hadoop-master.dragon.org                 #发送给安装gmetad的机器
  port = 8649                   #监听端口
  ttl = 1
} 
vi /etc/ganglia/gmetad.conf 
data_source "my cluster" localhost改为data_source "hadoop-cluster" 10 localhost  hadoop-master.dragon.org:8649
data_source "Hadoop" localhost hadoop-master.dragon.org  ---- Hadoop为cluster名称,后面是需要监控的主机名  
修改apache设置
vi /etc/httpd/conf.d/ganglia.conf  
文件内容Deny from all 为 allow from all
设置启动 
# chkconfig --add gmetad  
# chkconfig --add gmond  
# chkconfig --add httpd 
在主机上
service gmetad start
service gmond start
service httpd start
service gmetad stop
service gmond stop
service httpd stop


# service gmetad status    -------------------验证是否启动成功
# service gmond status   -------------------验证是否启动成功 
/ganglia/conf.php
$ganglia_ip = “127.0.0.1”; $ganglia_port=”8649”;
访问http://192.168.192.129/ganglia


$gmetad_root = "/var/lib/ganglia";
$rrds = "$gmetad_root/rrds";
define("RRDTOOL", "/usr/bin/rrdtool");
这两个变量与gmetad的配置一致，以正确获取到rrdtools存储的数据即可
常见问题
Forbidden错误时,因为对apache有一个设置
修改 /etc/httpd/conf.d/ganglia.conf文件内容Deny from all 为 allow from all
There was an error collecting ganglia data (127.0.0.1:8652):fsockopen error: Permission denied 解决方法
1 永久方法 – 需要重启服务器
修改/etc/selinux/config文件中设置SELINUX=disabled ，然后重启服务器。
2 临时方法 – 设置系统参数
使用命令setenforce 0
setenforce 1 设置SELinux 成为enforcing模式
setenforce 0 设置SELinux 成为permissive模式
There was an error collecting ganglia data (127.0.0.1:8652):fsockopen error: Connection refused 解决办法
卸载yum remove ganglia-web ganglia-gmetad
重新安装yum install ganglia-web    ----- ganglia-web本身有引用gmetad
重启即可
后来遇到错误： 
Cannot find any metrics for selected cluster "hadoop", exiting. Check ganglia XML tree (telnet 127.0.0.1 8652)   
弄了好久，最后在/var/www/html/ganglia/conf.php文件中修改了一下 $ganglia_ip = “127.0.0.1”; $ganglia_port=”8649”; 
这的端口号要和你在gmond.conf  中的一样




rpm -ivh http://dl.fedoraproject.org/pub/epel/6/i386/epel-release-6-8.noarch.rpm
rpm -ivh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm


国内访问修改为sohu提供的镜像：
vi /etc/yum.repos.d/epel.repo 
[epel]
name=Extra Packages for Enterprise Linux 6 - $basearch
#baseurl=http://download.fedoraproject.org/pub/epel/6/$basearch
baseurl=http://mirrors.sohu.com/fedora-epel/6/$basearch
#mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=epel-6&arch=$basearch
failovermethod=priority
enabled=1
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6
 
[epel-debuginfo]
name=Extra Packages for Enterprise Linux 6 - $basearch - Debug
#baseurl=http://download.fedoraproject.org/pub/epel/6/$basearch/debug
baseurl=http://mirrors.sohu.com/fedora-epel/6/$basearch/debug
#mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=epel-debug-6&arch=$basearch
failovermethod=priority
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6
gpgcheck=1
 
[epel-source]
name=Extra Packages for Enterprise Linux 6 - $basearch - Source
#baseurl=http://download.fedoraproject.org/pub/epel/6/SRPMS
baseurl=http://mirrors.sohu.com/fedora-epel/6/SRPMS
#mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=epel-source-6&arch=$basearch
failovermethod=priority
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6
gpgcheck=1