Hadoop HA高可用集群搭建（2.7.2）
1.集群规划：
主机名 IP 安装的软件 执行的进程
drguo1 192.168.80.149 jdk、hadoop NameNode、DFSZKFailoverController(zkfc)、ResourceManager
drguo2 192.168.80.150 jdk、hadoop NameNode、DFSZKFailoverController(zkfc)、ResourceManager
drguo3 192.168.80.151 jdk、hadoop、zookeeper DataNode、NodeManager、JournalNode、QuorumPeerMain
drguo4 192.168.80.152 jdk、hadoop、zookeeper DataNode、NodeManager、JournalNode、QuorumPeerMain
drguo5 192.168.80.153 jdk、hadoop、zookeeper DataNode、NodeManager、JournalNode、QuorumPeerMain
排的好好的，显示出来就乱了！！
！
2.前期准备：
准备五台机器，改动静态IP、主机名、主机名与IP的映射。关闭防火墙。安装JDK并配置环境变量（不会请看这http://blog.csdn.net/dr_guo/article/details/50886667），创建用户：用户组，SSH免password登录SSH免password登录（报错请看这http://blog.csdn.net/dr_guo/article/details/50967442）。
注意：要把127.0.1.1那一行凝视掉。要不然会出现jps显示有datanode，但网页显示live nodes为0。
凝视之后就正常了。好像有人没凝视也正常，我也不知道为什么0.0
3.搭建zookeeper集群（drguo3/drguo4/drguo5）
见：ZooKeeper全然分布式集群搭建
4.正式開始搭建Hadoop HA集群
去官网下最新的Hadoop（http://apache.opencas.org/hadoop/common/stable/），眼下最新的是2.7.2，下载完之后把它放到/opt/Hadoop下
[plain] view plain copy
- guo@guo:~/下载$ mv ./hadoop-2.7.2.tar.gz /opt/Hadoop/
- mv: 无法创建普通文件"/opt/Hadoop/hadoop-2.7.2.tar.gz": 权限不够
- guo@guo:~/下载$ su root
- password：
- root@guo:/home/guo/下载# mv ./hadoop-2.7.2.tar.gz /opt/Hadoop/
解压
[plain] view plain copy
- guo@guo:/opt/Hadoop$ sudo tar -zxf hadoop-2.7.2.tar.gz
- [sudo] guo 的password：
解压jdk的时候我用的是tar -zxvf。当中的v呢就是看一下解压的过程。不想看你能够不写。
改动opt文件夹全部者(用户：用户组)直接把opt文件夹的全部者/组换成了guo。详细情况在ZooKeeper全然分布式集群搭建说过。
[plain] view plain copy
- root@guo:/opt/Hadoop# chown -R guo:guo /opt
环境变量设置
[plain] view plain copy
- guo@guo:/opt/Hadoop$ sudo gedit /etc/profile
在最后加上（这样设置在运行bin/sbin文件夹下的脚本时就不用进入该文件夹用了）
[plain] view plain copy
- #hadoop
- export HADOOP_HOME=/opt/Hadoop/hadoop-2.7.2
- export PATH=$PATH:$HADOOP_HOME/sbin
- export PATH=$PATH:$HADOOP_HOME/bin
然后更新配置
[plain] view plain copy
- guo@guo:/opt/Hadoop$ source /etc/profile
改动/opt/Hadoop/hadoop-2.7.2/etc/hadoop下的hadoop-env.sh
[plain] view plain copy
- guo@guo:/opt/Hadoop$ cd hadoop-2.7.2
- guo@guo:/opt/Hadoop/hadoop-2.7.2$ cd etc/hadoop/
- guo@guo:/opt/Hadoop/hadoop-2.7.2/etc/hadoop$ sudo gedit ./hadoop-env.sh
进入文件后
[plain] view plain copy
- export JAVA_HOME=${JAVA_HOME}#将这个改成JDK路径，例如以下
- export JAVA_HOME=/opt/Java/jdk1.8.0_73
然后更新文件配置
[plain] view plain copy
- guo@guo:/opt/Hadoop/hadoop-2.7.2/etc/hadoop$ source ./hadoop-env.sh
前面配置和单机模式一样。我就直接复制了。
注意：汉语凝视是给你看的。复制粘贴的时候都删了。！！
改动core-site.xml
fs.defaultFS hdfs://ns1/ hadoop.tmp.dir /opt/Hadoop/hadoop-2.7.2/tmp ha.zookeeper.quorum drguo3:2181,drguo4:2181,drguo5:2181
改动hdfs-site.xml
dfs.nameservices ns1 dfs.ha.namenodes.ns1 nn1,nn2 dfs.namenode.rpc-address.ns1.nn1 drguo1:9000 dfs.namenode.http-address.ns1.nn1 drguo1:50070 dfs.namenode.rpc-address.ns1.nn2 drguo2:9000 dfs.namenode.http-address.ns1.nn2 drguo2:50070 dfs.namenode.shared.edits.dir qjournal://drguo3:8485;drguo4:8485;drguo5:8485/ns1 dfs.journalnode.edits.dir /opt/Hadoop/hadoop-2.7.2/journaldata dfs.ha.automatic-failover.enabled true dfs.client.failover.proxy.provider.ns1 org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider dfs.ha.fencing.methods sshfence shell(/bin/true) dfs.ha.fencing.ssh.private-key-files /home/guo/.ssh/id_rsa dfs.ha.fencing.ssh.connect-timeout 30000
先将mapred-site.xml.template改名为mapred-site.xml然后改动mapred-site.xml
mapreduce.framework.name yarn
改动yarn-site.xml
yarn.resourcemanager.ha.enabled true yarn.resourcemanager.cluster-id yrc yarn.resourcemanager.ha.rm-ids rm1,rm2 yarn.resourcemanager.hostname.rm1 drguo1 yarn.resourcemanager.hostname.rm2 drguo2 yarn.resourcemanager.zk-address drguo3:2181,drguo4:2181,drguo5:2181 yarn.nodemanager.aux-services mapreduce_shuffle
改动slaves
drguo3 drguo4 drguo5
把Hadoop整个文件夹复制到drguo2/3/4/5，拷之前把share下doc删了（文档不用拷）。这样会快点。
5.启动zookeeper集群（分别在drguo3、drguo4、drguo5上启动zookeeper）
guo@drguo3:~$ zkServer.sh start ZooKeeper JMX enabled by default Using config: /opt/zookeeper-3.4.8/bin/../conf/zoo.cfg Starting zookeeper ... STARTED guo@drguo3:~$ jps 2005 Jps 1994 QuorumPeerMain guo@drguo3:~$ ssh drguo4 Welcome to Ubuntu 15.10 (GNU/Linux 4.2.0-16-generic x86_64) * Documentation: https://help.ubuntu.com/ Last login: Fri Mar 25 14:04:43 2016 from 192.168.80.151 guo@drguo4:~$ zkServer.sh start ZooKeeper JMX enabled by default Using config: /opt/zookeeper-3.4.8/bin/../conf/zoo.cfg Starting zookeeper ... STARTED guo@drguo4:~$ jps 1977 Jps 1966 QuorumPeerMain guo@drguo4:~$ exit 注销 Connection to drguo4 closed. guo@drguo3:~$ ssh drguo5 Welcome to Ubuntu 15.10 (GNU/Linux 4.2.0-16-generic x86_64) * Documentation: https://help.ubuntu.com/ Last login: Fri Mar 25 14:04:56 2016 from 192.168.80.151 guo@drguo5:~$ zkServer.sh start ZooKeeper JMX enabled by default Using config: /opt/zookeeper-3.4.8/bin/../conf/zoo.cfg Starting zookeeper ... STARTED guo@drguo5:~$ jps 2041 Jps 2030 QuorumPeerMain guo@drguo5:~$ exit 注销 Connection to drguo5 closed. guo@drguo3:~$ zkServer.sh status ZooKeeper JMX enabled by default Using config: /opt/zookeeper-3.4.8/bin/../conf/zoo.cfg Mode: leader
6.启动journalnode（分别在drguo3、drguo4、drguo5上启动journalnode）注意仅仅有第一次须要这么启动，之后启动hdfs会包括journalnode。
guo@drguo3:~$ hadoop-daemon.sh start journalnode starting journalnode, logging to /opt/Hadoop/hadoop-2.7.2/logs/hadoop-guo-journalnode-drguo3.out guo@drguo3:~$ jps 2052 Jps 2020 JournalNode 1963 QuorumPeerMain guo@drguo3:~$ ssh drguo4 Welcome to Ubuntu 15.10 (GNU/Linux 4.2.0-16-generic x86_64) * Documentation: https://help.ubuntu.com/ Last login: Fri Mar 25 00:09:08 2016 from 192.168.80.149 guo@drguo4:~$ hadoop-daemon.sh start journalnode starting journalnode, logging to /opt/Hadoop/hadoop-2.7.2/logs/hadoop-guo-journalnode-drguo4.out guo@drguo4:~$ jps 2103 Jps 2071 JournalNode 1928 QuorumPeerMain guo@drguo4:~$ exit 注销 Connection to drguo4 closed. guo@drguo3:~$ ssh drguo5 Welcome to Ubuntu 15.10 (GNU/Linux 4.2.0-16-generic x86_64) * Documentation: https://help.ubuntu.com/ Last login: Thu Mar 24 23:52:17 2016 from 192.168.80.152 guo@drguo5:~$ hadoop-daemon.sh start journalnode starting journalnode, logging to /opt/Hadoop/hadoop-2.7.2/logs/hadoop-guo-journalnode-drguo5.out guo@drguo5:~$ jps 2276 JournalNode 2308 Jps 1959 QuorumPeerMain guo@drguo5:~$ exit 注销 Connection to drguo5 closed.
在drguo4/5启动时发现了问题，没有journalnode，查看日志发现是由于汉语凝视造成的，drguo4/5全删了问题解决。drguo4/5的拼音输入法也不能用，我非常蛋疼。。
镜像都是复制的。咋还变异了呢。
7.格式化HDFS(在drguo1上运行)
guo@drguo1:/opt$ hdfs namenode -format
这回又出问题了，还是汉语凝视闹得，drguo1/2/3也全删了，问题解决。
注意：格式化之后须要把tmp文件夹拷给drguo2（不然drguo2的namenode起不来）
guo@drguo1:/opt/Hadoop/hadoop-2.7.2$ scp -r tmp/ drguo2:/opt/Hadoop/hadoop-2.7.2/
8.格式化ZKFC(在drguo1上运行)
guo@drguo1:/opt$ hdfs zkfc -formatZK
9.启动HDFS(在drguo1上运行)
guo@drguo1:/opt$ start-dfs.sh
10.启动YARN(在drguo1上运行)
guo@drguo1:/opt$ start-yarn.sh
PS:
1.drguo2的resourcemanager须要手动单独启动：
yarn-daemon.sh start resourcemanager
2.namenode、datanode也能够单独启动：
hadoop-daemon.sh start namenode
hadoop-daemon.sh start datanode
3.NN 由standby转化成active
hdfs haadmin -transitionToActive nn1 --forcemanual
大功告成！！
！
