Docker容器部署CDH6.3.0(二):容器安装ClouderaManager

文章目录

  • 阿里云配置
  • 2.1 初始化环境
  • 2.2 配置中文环境变量
  • 2.3 这两个命令的主机名是否一致
  • 2.4 检查eth0网卡是否开启
  • 2.5 是否能上网
  • 2.6 配置NTP时间同步服务
  • 2.7 准备MySQL安装包
  • 2.8 准备MySQL JDBC驱动
  • 2.9 准备Cloudera-Manager安装包
  • 2.10 准备Parcel包
  • 2.11 搭建本地yum源
  • 2.12 安装JDK
  • 2.13 安装配置MySQL数据库
  • 2.14 数据库授权
  • 2.15 配置mysql jdbc驱动
  • 2.16 安装Cloudera Manager
  • 2.17 配置parcel库
  • 2.18 初始化scm库
  • 2.19 启动服务

阿里云配置

类型 配置
CPU 4核
内存 32 GiB
硬盘 200 G
操作系统 CentOS 7.6 64位

Docker容器部署CDH6.3.0(一):宿主机初始化:https://blog.csdn.net/qq_39680564/article/details/99478888

2.1 初始化环境

使用Xshell或其它工具ssh连接容器,容器的用户密码为root/root

yum install -y kde-l10n-Chinese telnet reinstall glibc-common vim wget ntp net-tools \
&& yum clean all

执行结果

Installed:
  kde-l10n-Chinese.noarch 0:4.10.5-2.el7      net-tools.x86_64 0:2.0-0.24.20131004git.el7      ntp.x86_64 0:4.2.6p5-28.el7.centos      telnet.x86_64 1:0.17-64.el7      vim-enhanced.x86_64 2:7.4.160-6.el7_6     
  wget.x86_64 0:1.14-18.el7_6.1              

2.2 配置中文环境变量

(
cat <<EOF
export LC_ALL=zh_CN.utf8
export LANG=zh_CN.utf8
export LANGUAGE=zh_CN.utf8
EOF
) >> ~/.bashrc \
&& localedef -c -f UTF-8 -i zh_CN zh_CN.utf8 \
&& source ~/.bashrc \
&& echo $LANG

执行结果

zh_CN.utf8

2.3 这两个命令的主机名是否一致

uname -a && hostname

执行结果

[root@cm ~]# uname -a && hostname
Linux cm.hadoop 3.10.0-957.21.3.el7.x86_64 #1 SMP Tue Jun 18 16:35:19 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
cm.hadoop

2.4 检查eth0网卡是否开启

ifconfig | head -n2

执行结果

eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 172.10.0.2  netmask 255.255.0.0  broadcast 172.10.255.255

2.5 是否能上网

ping www.baidu.com -c 3

执行结果

PING www.a.shifen.com (220.181.38.150) 56(84) bytes of data.
64 bytes from 220.181.38.150 (220.181.38.150): icmp_seq=1 ttl=50 time=7.68 ms
64 bytes from 220.181.38.150 (220.181.38.150): icmp_seq=2 ttl=50 time=7.63 ms
64 bytes from 220.181.38.150 (220.181.38.150): icmp_seq=3 ttl=50 time=7.58 ms

--- www.a.shifen.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 7.586/7.634/7.686/0.040 ms

2.6 配置NTP时间同步服务

vim /etc/ntp.conf
#更改为以下四个时钟服务器
server 0.cn.pool.ntp.org
server 1.cn.pool.ntp.org
server 2.cn.pool.ntp.org	
server 3.cn.pool.ntp.org

启动ntp服务

systemctl start ntpd && \
systemctl enable ntpd && \
ntpdate -u 0.cn.pool.ntp.org && \
hwclock --systohc && \
date 

执行结果

Created symlink from /etc/systemd/system/multi-user.target.wants/ntpd.service to /usr/lib/systemd/system/ntpd.service.
14 Aug 10:18:01 ntpdate[1853]: adjust time server 139.199.214.202 offset 0.005992 sec
2019年 08月 14日 星期三 10:18:02 CST

2.7 准备MySQL安装包

mkdir -p /root/hadoop_CHD/mysql \
&& wget -O /root/hadoop_CHD/mysql/mysql-5.7.27-1.el7.x86_64.rpm-bundle.tar \
https://dev.mysql.com/get/Downloads/MySQL-5.7/mysql-5.7.27-1.el7.x86_64.rpm-bundle.tar \
&& ls /root/hadoop_CHD/mysql

执行结果

mysql-5.7.27-1.el7.x86_64.rpm-bundle.tar

2.8 准备MySQL JDBC驱动

mkdir -p /root/hadoop_CHD/mysql-jdbc \
&& wget -O /root/hadoop_CHD/mysql-jdbc/mysql-connector-java-5.1.48.tar.gz \
https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.48.tar.gz \
&& ls /root/hadoop_CHD/mysql-jdbc

执行结果

mysql-connector-java-5.1.48.tar.gz

2.9 准备Cloudera-Manager安装包

mkdir -p /root/hadoop_CHD/cloudera-repos \
&& wget -O /root/hadoop_CHD/cloudera-repos/allkeys.asc \
https://archive.cloudera.com/cm6/6.3.0/allkeys.asc \
&& wget -O /root/hadoop_CHD/cloudera-repos/cloudera-manager-agent-6.3.0-1281944.el7.x86_64.rpm \
https://archive.cloudera.com/cm6/6.3.0/redhat7/yum/RPMS/x86_64/cloudera-manager-agent-6.3.0-1281944.el7.x86_64.rpm \
&& wget -O /root/hadoop_CHD/cloudera-repos/cloudera-manager-daemons-6.3.0-1281944.el7.x86_64.rpm \
https://archive.cloudera.com/cm6/6.3.0/redhat7/yum/RPMS/x86_64/cloudera-manager-daemons-6.3.0-1281944.el7.x86_64.rpm \
&& wget -O /root/hadoop_CHD/cloudera-repos/cloudera-manager-server-6.3.0-1281944.el7.x86_64.rpm \
https://archive.cloudera.com/cm6/6.3.0/redhat7/yum/RPMS/x86_64/cloudera-manager-server-6.3.0-1281944.el7.x86_64.rpm \
&& wget -O /root/hadoop_CHD/cloudera-repos/cloudera-manager-server-db-2-6.3.0-1281944.el7.x86_64.rpm \
https://archive.cloudera.com/cm6/6.3.0/redhat7/yum/RPMS/x86_64/cloudera-manager-server-db-2-6.3.0-1281944.el7.x86_64.rpm \
&& wget -O /root/hadoop_CHD/cloudera-repos/enterprise-debuginfo-6.3.0-1281944.el7.x86_64.rpm \
https://archive.cloudera.com/cm6/6.3.0/redhat7/yum/RPMS/x86_64/enterprise-debuginfo-6.3.0-1281944.el7.x86_64.rpm \
&& wget -O /root/hadoop_CHD/cloudera-repos/oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm \
https://archive.cloudera.com/cm6/6.3.0/redhat7/yum/RPMS/x86_64/oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm \
&& ll /root/hadoop_CHD/cloudera-repos

执行结果

total 1378004
-rw-r--r-- 1 root root      14041 8月   1 00:08 allkeys.asc
-rw-r--r-- 1 root root   10479136 8月   1 00:08 cloudera-manager-agent-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root 1201341068 8月   1 00:08 cloudera-manager-daemons-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root      11464 8月   1 00:08 cloudera-manager-server-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root      10996 8月   1 00:08 cloudera-manager-server-db-2-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root   14209884 8月   1 00:08 enterprise-debuginfo-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root  184988341 8月   1 00:08 oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm

2.10 准备Parcel包

mkdir -p /root/hadoop_CHD/parcel \
&& wget -O /root/hadoop_CHD/parcel/CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel \
https://archive.cloudera.com/cdh6/6.3.0/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel \
&& wget -O /root/hadoop_CHD/parcel/manifest.json \
https://archive.cloudera.com/cdh6/6.3.0/parcels/manifest.json \
&& ll /root/hadoop_CHD/parcel

执行结果

total 2036848
-rw-r--r-- 1 root root 2085690155 8月   1 00:03 CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel
-rw-r--r-- 1 root root      33887 8月   1 00:04 manifest.json

2.11 搭建本地yum源

yum -y install httpd createrepo \
&& systemctl start httpd \
&& systemctl enable httpd \
&& cd /root/hadoop_CHD/cloudera-repos/ && createrepo . \
&& mv /root/hadoop_CHD/cloudera-repos /var/www/html/ \
&& yum clean all \
&& ll /var/www/html/cloudera-repos

执行结果

total 1378008
-rw-r--r-- 1 root root      14041 8月   1 00:08 allkeys.asc
-rw-r--r-- 1 root root   10479136 8月   1 00:08 cloudera-manager-agent-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root 1201341068 8月   1 00:08 cloudera-manager-daemons-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root      11464 8月   1 00:08 cloudera-manager-server-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root      10996 8月   1 00:08 cloudera-manager-server-db-2-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root   14209884 8月   1 00:08 enterprise-debuginfo-6.3.0-1281944.el7.x86_64.rpm
-rw-r--r-- 1 root root  184988341 8月   1 00:08 oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm
drwxr-xr-x 2 root root       4096 8月  14 11:05 repodata

2.12 安装JDK

cd /var/www/html/cloudera-repos/;rpm -ivh oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm

执行结果

warning: oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID b0b19c9f: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:oracle-j2sdk1.8-1.8.0+update181-1################################# [100%]

2.13 安装配置MySQL数据库

cd /root/hadoop_CHD/mysql/;tar -xvf mysql-5.7.27-1.el7.x86_64.rpm-bundle.tar \
&& yum install -y libaio numactl \
&& rpm -ivh mysql-community-common-5.7.27-1.el7.x86_64.rpm \
&& rpm -ivh mysql-community-libs-5.7.27-1.el7.x86_64.rpm \
&& rpm -ivh mysql-community-client-5.7.27-1.el7.x86_64.rpm \
&& rpm -ivh mysql-community-server-5.7.27-1.el7.x86_64.rpm \
&& rpm -ivh mysql-community-libs-compat-5.7.27-1.el7.x86_64.rpm \
&& echo character-set-server=utf8 >> /etc/my.cnf \
&& rm -rf /root/hadoop_CHD/mysql/ \
&& yum clean all \
&& rpm -qa |grep mysql 

执行结果

Installed:
  libaio.x86_64 0:0.3.109-13.el7                                                                           numactl.x86_64 0:2.0.9-7.el7                                                                          

Dependency Installed:
  numactl-libs.x86_64 0:2.0.9-7.el7                                                                                                                                                                               

Complete!
warning: mysql-community-common-5.7.27-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-common-5.7.27-1.e################################# [100%]
warning: mysql-community-libs-5.7.27-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-libs-5.7.27-1.el7################################# [100%]
warning: mysql-community-client-5.7.27-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-client-5.7.27-1.e################################# [100%]
warning: mysql-community-server-5.7.27-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-server-5.7.27-1.e################################# [100%]
warning: mysql-community-libs-compat-5.7.27-1.el7.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mysql-community-libs-compat-5.7.2################################# [100%]
mysql-community-libs-5.7.27-1.el7.x86_64
mysql-community-server-5.7.27-1.el7.x86_64
mysql-community-common-5.7.27-1.el7.x86_64
mysql-community-client-5.7.27-1.el7.x86_64
mysql-community-libs-compat-5.7.27-1.el7.x86_64

2.14 数据库授权

编写SQL脚本

(
cat <<EOF
set password for root@localhost = password('123456Aa.');
grant all privileges on *.* to 'root'@'%' identified by '123456Aa.';
flush privileges;
CREATE DATABASE scm DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE amon DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE rman DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE hue DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE metastore DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE sentry DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE nav DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE navms DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE oozie DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON scm.* TO 'scm'@'%' IDENTIFIED BY '123456Aa.';
GRANT ALL ON amon.* TO 'amon'@'%' IDENTIFIED BY '123456Aa.';
GRANT ALL ON rman.* TO 'rman'@'%' IDENTIFIED BY '123456Aa.';
GRANT ALL ON hue.* TO 'hue'@'%' IDENTIFIED BY '123456Aa.';
GRANT ALL ON metastore.* TO 'hive'@'%' IDENTIFIED BY '123456Aa.';
GRANT ALL ON sentry.* TO 'sentry'@'%' IDENTIFIED BY '123456Aa.';
GRANT ALL ON nav.* TO 'nav'@'%' IDENTIFIED BY '123456Aa.';
GRANT ALL ON navms.* TO 'navms'@'%' IDENTIFIED BY '123456Aa.';
GRANT ALL ON oozie.* TO 'oozie'@'%' IDENTIFIED BY '123456Aa.';
SHOW DATABASES;
EOF
) >> /root/c.sql

获取MySQL初始密码

systemctl start mysqld && grep password /var/log/mysqld.log | sed 's/.*\(............\)$/\1/'

执行SQL脚本

[root@cm ~]# mysql -uroot -p
Enter password: 
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 4
Server version: 5.7.27

Copyright (c) 2000, 2019, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> source /root/c.sql

执行结果

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 1 row affected (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

Query OK, 0 rows affected, 1 warning (0.01 sec)

Query OK, 0 rows affected, 1 warning (0.00 sec)

+--------------------+
| Database           |
+--------------------+
| information_schema |
| amon               |
| hue                |
| metastore          |
| mysql              |
| nav                |
| navms              |
| oozie              |
| performance_schema |
| rman               |
| scm                |
| sentry             |
| sys                |
+--------------------+
13 rows in set (0.00 sec)

2.15 配置mysql jdbc驱动

mkdir -p /usr/share/java/ \
&& cd /root/hadoop_CHD/mysql-jdbc/;tar -zxvf mysql-connector-java-5.1.48.tar.gz \
&& cp  /root/hadoop_CHD/mysql-jdbc/mysql-connector-java-5.1.48/mysql-connector-java-5.1.48-bin.jar /usr/share/java/mysql-connector-java.jar \
&& rm -rf /root/hadoop_CHD/mysql-jdbc/ \
&& ls /usr/share/java/

执行结果

mysql-connector-java.jar

2.16 安装Cloudera Manager

(
cat <<EOF
[cloudera-manager]
name=Cloudera Manager 6.3.0
baseurl=http://172.10.0.2/cloudera-repos/
gpgcheck=0
enabled=1
EOF
) >> /etc/yum.repos.d/cloudera-manager.repo \
&& yum clean all \
&& yum makecache \
&& yum install -y cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server \
&& yum clean all \
&& rpm -qa | grep cloudera-manager 

执行结果

Installed:
  cloudera-manager-agent.x86_64 0:6.3.0-1281944.el7                   cloudera-manager-daemons.x86_64 0:6.3.0-1281944.el7                   cloudera-manager-server.x86_64 0:6.3.0-1281944.el7                  

Dependency Installed:
  GeoIP.x86_64 0:1.5.0-13.el7                   MySQL-python.x86_64 0:1.2.5-1.el7                 at.x86_64 0:3.1.13-24.el7                                    avahi-libs.x86_64 0:0.6.31-19.el7                 
  bc.x86_64 0:1.06.95-13.el7                    bind-libs.x86_64 32:9.9.4-74.el7_6.2              bind-utils.x86_64 32:9.9.4-74.el7_6.2                        cronie.x86_64 0:1.4.11-20.el7_6                   
  cronie-anacron.x86_64 0:1.4.11-20.el7_6       crontabs.noarch 0:1.11-6.20121102git.el7          cups-client.x86_64 1:1.6.3-35.el7                            cups-libs.x86_64 1:1.6.3-35.el7                   
  cyrus-sasl-gssapi.x86_64 0:2.1.26-23.el7      cyrus-sasl-plain.x86_64 0:2.1.26-23.el7           ed.x86_64 0:1.9-4.el7                                        file.x86_64 0:5.11-35.el7                         
  fuse.x86_64 0:2.9.2-11.el7                    fuse-libs.x86_64 0:2.9.2-11.el7                   gettext.x86_64 0:0.19.8.1-2.el7                              gettext-libs.x86_64 0:0.19.8.1-2.el7              
  initscripts.x86_64 0:9.49.46-1.el7            iproute.x86_64 0:4.11.0-14.el7_6.2                iptables.x86_64 0:1.4.21-28.el7                              keyutils-libs-devel.x86_64 0:1.5.8-3.el7          
  krb5-devel.x86_64 0:1.15.1-37.el7_6           less.x86_64 0:458-9.el7                           libcom_err-devel.x86_64 0:1.42.9-13.el7                      libcroco.x86_64 0:0.6.12-4.el7                    
  libgomp.x86_64 0:4.8.5-36.el7_6.2             libkadm5.x86_64 0:1.15.1-37.el7_6                 libmnl.x86_64 0:1.0.3-7.el7                                  libnetfilter_conntrack.x86_64 0:1.0.6-1.el7_3     
  libnfnetlink.x86_64 0:1.0.1-4.el7             libpipeline.x86_64 0:1.2.3-3.el7                  libselinux-devel.x86_64 0:2.5-14.1.el7                       libsepol-devel.x86_64 0:2.5-10.el7                
  libtirpc.x86_64 0:0.2.4-0.15.el7              libunistring.x86_64 0:0.9.3-9.el7                 libverto-devel.x86_64 0:0.2.5-4.el7                          libxslt.x86_64 0:1.1.28-5.el7                     
  m4.x86_64 0:1.4.16-10.el7                     mailx.x86_64 0:12.5-19.el7                        make.x86_64 1:3.82-23.el7                                    man-db.x86_64 0:2.6.3-11.el7                      
  mod_ssl.x86_64 1:2.4.6-89.el7.centos.1        openssl.x86_64 1:1.0.2k-16.el7_6.1                openssl-devel.x86_64 1:1.0.2k-16.el7_6.1                     patch.x86_64 0:2.7.1-10.el7_5                     
  pcre-devel.x86_64 0:8.32-17.el7               postfix.x86_64 2:2.10.1-7.el7                     postgresql-libs.x86_64 0:9.2.24-1.el7_5                      psmisc.x86_64 0:22.20-15.el7                      
  python-psycopg2.x86_64 0:2.5.1-3.el7          redhat-lsb-core.x86_64 0:4.1-27.el7.centos.1      redhat-lsb-submod-security.x86_64 0:4.1-27.el7.centos.1      rpcbind.x86_64 0:0.2.0-47.el7                     
  spax.x86_64 0:1.5.2-13.el7                    systemd-sysv.x86_64 0:219-62.el7_6.9              sysvinit-tools.x86_64 0:2.88-14.dsf.el7                      time.x86_64 0:1.7-45.el7                          
  zlib-devel.x86_64 0:1.2.7-18.el7             

Dependency Updated:
  bind-license.noarch 32:9.9.4-74.el7_6.2                openssl-libs.x86_64 1:1.0.2k-16.el7_6.1                systemd.x86_64 0:219-62.el7_6.9                systemd-libs.x86_64 0:219-62.el7_6.9               

Complete!
Loaded plugins: fastestmirror, ovl
Cleaning repos: base cloudera-manager extras updates
Cleaning up list of fastest mirrors
cloudera-manager-server-6.3.0-1281944.el7.x86_64
cloudera-manager-daemons-6.3.0-1281944.el7.x86_64
cloudera-manager-agent-6.3.0-1281944.el7.x86_64

2.17 配置parcel库

cd /opt/cloudera/parcel-repo/;mv /root/hadoop_CHD/parcel/* ./ \
&& sha1sum CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel| awk '{ print $1 }' >CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel.sha \
&& rm -rf /root/hadoop_CHD/parcel/ \
&& chown -R cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo/* \
&& ll /opt/cloudera/parcel-repo/ 

执行结果

total 2036852
-rw-r--r-- 1 cloudera-scm cloudera-scm 2085690155 8月   1 00:03 CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel
-rw-r--r-- 1 cloudera-scm cloudera-scm         41 8月  14 11:38 CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel.sha
-rw-r--r-- 1 cloudera-scm cloudera-scm      33887 8月   1 00:04 manifest.json

2.18 初始化scm库

/opt/cloudera/cm/schema/scm_prepare_database.sh mysql scm scm 123456Aa.

执行结果

[root@cm parcel-repo]# /opt/cloudera/cm/schema/scm_prepare_database.sh mysql scm scm 123456Aa.
JAVA_HOME=/usr/java/jdk1.8.0_181-cloudera
Verifying that we can write to /etc/cloudera-scm-server
Creating SCM configuration file in /etc/cloudera-scm-server
Executing:  /usr/java/jdk1.8.0_181-cloudera/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/java/postgresql-connector-java.jar:/opt/cloudera/cm/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db.
Wed Aug 14 11:39:18 CST 2019 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
[                          main] DbCommandExecutor              INFO  Successfully connected to database.
All done, your SCM database is configured correctly!

2.19 启动服务

systemctl start cloudera-scm-server \
&& sleep 2 \
&& tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log | grep "INFO WebServerImpl:com.cloudera.server.cmf.WebServerImpl: Started Jetty server"

执行结果

2019-08-14 11:42:34,191 INFO WebServerImpl:com.cloudera.server.cmf.WebServerImpl: Started Jetty server.

查到日志出现这句话,就可以浏览器访问CM了,默认用户名密码:admin/admin
http://IP:7180
访问不了的话去检查宿主机的防火墙和阿里云的安全组规则有没有开放7180

你可能感兴趣的:(Hadoop_CDH,Docker)