CDH安装: rpm包+parcel

• 由于网络不稳定，下载rpm包经常中断，不方便完成任务，所以通过wget下载：

 nohup wget -t 0 -w 10 -c -r -nd -np  -L -p   http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5/RPMS/x86_64/ &
 nohup wget -t 0 -w 10 -c -r -nd -np  -L -p   http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5/RPMS/noarch/ &

-t,  --tries=NUMBER            set number of retries to NUMBER (0 unlimits)
-w,  --wait=SECONDS            wait SECONDS between retrievals
-nd, --no-directories           don’t create directories
-np, --no-parent                 don’t ascend to the parent directory
-c,  --continue                resume getting a partially-downloaded file.                         
-L,  --relative                  follow relative links only.
-p,  --page-requisites    get all images, etc. needed to display HTML page.

• 安装文档：https://docs.cloudera.com/documentation/enterprise/5-12-x/topics/installation.html

1，cm 的rpm 包下载地址：

a,　cm安装包下载

http://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.16/RPMS/x86_64/

b,　cm二进制文件

archive.cloudera.com/cm5/installer/5.16.1/cloudera-manager-installer.bin

2， 安装rpm包

install-cdh.sh

#安装jdk
rpm -ivh jdk-6u31-linux-amd64.rpm
rpm -ivh oracle-j2sdk1.7-1.7.0up+date67-1.x86_64.rpm
ln -sf /usr/java/jdk1.7.0_67-cloudera/ /usr/java/jdk
echo 'export JAVA_HOME=/usr/java/jdk'>> /etc/profile
echo 'export PATH=$PATH:$JAVA_HOME/bin'>>/etc/profile
source /etc/profile

#安装cm-server,cm-agent
rpm -ivh cloudera-manager-daemons-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
rpm -ivh cloudera-manager-server-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
rpm -ivh cloudera-manager-agent-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
rpm -ivh cloudera-manager-server-db-2-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
rpm -ivh enterprise-debuginfo-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm

# 安装cm
chmod +x  cloudera-manager-installer.bin	
./cloudera-manager-installer.bin	

###依据提示： 关闭防火墙， 禁用selinux， 移除/etc/cloudera-scm-server/db.properties
###查看安装日志：
[root@cdh ~]# ls /var/log/cloudera-manager-installer/
0.check-selinux.log                         4.check-for-systemd.log
10.delete-embedded-db.log                   4.remove-cloudera-manager-repository.log
11.remove-cloudera-manager-server-db-2.log  5.install-cloudera-manager-server-db-2.log
12.remove-cloudera-manager-server.log       6.daemon-reload.log
13.remove-cloudera-manager-daemons.log      7.start-embedded-db.log
14.remove-cloudera-manager-repository.log   8.start-scm-server.log
1.install-repo-pkg.log                      9.stop-embedded-db.log
2.install-oracle-j2sdk1.7.log               uninstall.log
3.install-cloudera-manager-server.log

### cm使用的数据库：
[root@cdh ~]# ls /etc/cloudera-scm-server
db.mgmt.properties                  db.properties                  log4j.properties
db.mgmt.properties.20190320-234106  db.properties.20190320-234106
db.mgmt.properties.20190321-003144  db.properties.rpmsave

[root@cdh ~]# cat /etc/cloudera-scm-server/db.properties
# Auto-generated by initialize_embedded_db.sh
# These are database settings for CM Manager
com.cloudera.cmf.db.type=postgresql
com.cloudera.cmf.db.host=localhost:7432
com.cloudera.cmf.db.name=scm
com.cloudera.cmf.db.user=scm
com.cloudera.cmf.db.password=16zgvY6rs2
com.cloudera.cmf.db.setupType=EMBEDDED

#使用mysql作为元数据库，修改db.properties配置
mv mysql-connector-java-5.1.39-bin.jar mysql-connector-java.jar
cp mysql-connector-java.jar /usr/share/java 

3，安装失败，卸载重装

/usr/share/cmf/uninstall-cloudera-manager.sh

4，agent启动报错： Error, CM server guid updated

[01/Apr/2019 02:00:17 +0000] 16800 MainThread agent        ERROR    Error, CM server guid updated, expected d45ae888-ad12-489b-a08b-463ff64f918f, received 87a0fdcf-10b8-478d-b97e-13e7ca03a6d1

==解决： cloudera-scm-agent stop && /var/lib/cloudera-scm-agent/cm_guid &&  cloudera-scm-agent start

5, 下载parcel文件，安装hadoop集群

http://archive.cloudera.com/cdh5/parcels/5.16/

选择对应的版本下载后，放到/opt/cloudera/parcel-repo下， sha1文件重命名为sha文件

安装过程同cm解压安装，见https://blog.csdn.net/eyeofeagle/article/details/82155363#t5