阿里云Hadoop集群部署(2)-配置多台机器互信认

前面购买好阿里云机器后,接下来进行集群机器间的互信任操作

购买配置请参考

• https://blog.csdn.net/huonan_123/article/details/84549216

• 小技巧 在xshell中同时操作多个窗口(鼠标右键,选择如下如图箭头所示)

1. 创建用户

[root@hadoop002 ~]# useradd hadoop

2. 上传文件(root)

[root@hadoop001 software]$ ll
total 509828
-rw-r--r-- 1 root root 311585484 Nov 26 14:23 hadoop-2.6.0-cdh5.7.0.tar.gz
-rw-r--r-- 1 root root 173271626 Nov 26 14:23 jdk-8u45-linux-x64.gz
-rw-r--r-- 1 root root  37191810 Nov 26 14:23 zookeeper-3.4.13.tar.gz

3. 复制到每台机器上

scp root@ip/home/hadoop/software

[hadoop@hadoop001 software]$ hostname -i
172.18.97.104
[hadoop@hadoop001 software]$ scp [email protected]/home/hadoop/software

4. 修改上传软件权限

[root@hadoop001 ~]# chown -R hadoop:hadoop /home/hadoop/software/*

5. 修改hosts文件

[root@hadoop001 ~]# vim /etc/hosts

172.18.97.104   hadoop001       hadoop001
172.18.97.106   hadoop002       hadoop002
172.18.97.105   hadoop003       hadoop003

配置多台机器信任

1. 删除 .ssh文件

[hadoop@hadoop001 ~]$ ll -a
total 48
drwx------  8 hadoop hadoop 4096 Nov 26 14:28 .
drwxr-xr-x. 3 root   root   4096 Nov 26 13:01 ..
drwxrwxr-x  2 hadoop hadoop 4096 Nov 26 14:13 app
-rw-------  1 hadoop hadoop 1159 Nov 26 14:28 .bash_history
-rw-r--r--  1 hadoop hadoop   18 Mar 23  2017 .bash_logout
-rw-r--r--  1 hadoop hadoop  176 Mar 23  2017 .bash_profile
-rw-r--r--  1 hadoop hadoop  124 Mar 23  2017 .bashrc
drwxrwxr-x  2 hadoop hadoop 4096 Nov 26 14:13 data
drwxrwxr-x  2 hadoop hadoop 4096 Nov 26 14:13 lib
drwxrwxr-x  2 hadoop hadoop 4096 Nov 26 14:23 software
drwxrwxr-x  2 hadoop hadoop 4096 Nov 26 14:13 source
drwx------  2 hadoop hadoop 4096 Nov 26 14:23 .ssh
[hadoop@hadoop001 ~]$ rm -rf .ssh

2. 生成密匙

命令:ssh-keygen

[hadoop@hadoop001 ~]$ ssh-keygen
Generating public/private rsa key pair.
Enter file in which to save the key (/home/hadoop/.ssh/id_rsa): 
Created directory '/home/hadoop/.ssh'.
Enter passphrase (empty for no passphrase): 
Enter same passphrase again: 
Your identification has been saved in /home/hadoop/.ssh/id_rsa.
Your public key has been saved in /home/hadoop/.ssh/id_rsa.pub.
The key fingerprint is:
4a:c3:e0:f4:93:9e:95:79:fa:e3:e9:13:0c:5e:b3:b8 hadoop@hadoop001
The key's randomart image is:
+--[ RSA 2048]----+
|                 |
|                 |
|    o            |
|   o + ..oo      |
|    . B.S=.o     |
|     o *oo+      |
|      + .. .     |
|        E.o.     |
|         o=o     |
+-----------------+
[hadoop@hadoop001 ~]$ cd .ssh
[hadoop@hadoop001 .ssh]$ ll
total 8
-rw------- 1 hadoop hadoop 1675 Nov 26 14:55 id_rsa
-rw-r--r-- 1 hadoop hadoop  398 Nov 26 14:55 id_rsa.pub
[hadoop@hadoop001 .ssh]$ 

3. 复制其他机器的公秘钥到hadoop001这台机器的.ssh文件夹下

命令: scp id_rsa.pub root@hadoop001:/home/hadoop/.ssh/id_rsa.pub2

[hadoop@hadoop002 .ssh]$ scp id_rsa.pub root@hadoop001:/home/hadoop/.ssh/id_rsa.pub2

[hadoop@hadoop003 .ssh]$ scp id_rsa.pub root@hadoop001:/home/hadoop/.ssh/id_rsa.pub3

• 结果

[hadoop@hadoop001 .ssh]$ ll
total 24
-rw------- 1 hadoop hadoop 1675 Nov 26 14:55 id_rsa
-rw-r--r-- 1 hadoop hadoop  398 Nov 26 14:55 id_rsa.pub
-rw-r--r-- 1 hadoop hadoop  398 Nov 26 14:59 id_rsa.pub2
-rw-r--r-- 1 hadoop hadoop  398 Nov 26 15:00 id_rsa.pub3
-rw-r--r-- 1 hadoop hadoop 1215 Nov 26 15:09 known_hosts

4. 拷贝每个机器的公共密匙到authorized_keys

[hadoop@hadoop001 .ssh]$ rm -rf authorized_keys 
[hadoop@hadoop001 .ssh]$ cat id_rsa.pub >> authorized_keys
[hadoop@hadoop001 .ssh]$  cat id_rsa.pub2 >> authorized_keys
[hadoop@hadoop001 .ssh]$ cat id_rsa.pub3 >> authorized_keys

5. 查看 authorized_keys

ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAqAvZizpNIEl+32LuSYOc4Bvl4kxU5qq7C066nBBWDuyq2BtuO1tmZKooppFka55HF9CgM8R92gIFLo0OFTWWOyttHo/qPdcxgRxq4jDF8ogHlO/q8l84ONQjtlskLQx4mfG3I16evc1PFcJRkcXiuw1jbp5vwZVpEG1yTYig8HpRBHjuj4jewYGHN1iCJQOsuzVJED3DH2iVPfNzU8sytB3BxSH5ffbVlvD2g3FQHl79fkyO9JrWGVm4aTHc19nCDXCuAZtiMzoZNV3njLkhpIiDvwQFH/oYkjAaQ0JtqD/QBmcBEUAr2aMa2+boEQFL6x5F7TiMSrdLKihuQWRSxw== hadoop@hadoop001
ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAm8DDOAFirZ9/2lmsSibllTraWHjS/Vz31N6p87fL89/elqZZlJTEpnuEXWKU5NQm0uBOyVo/PtGHbA1a+RvEwfLjqfjM7jnRFeLxIl8YfUEzYnD25e4v8o9pIUzhGNE72rlccrsSEJob8T5L+oudcvhhYGK8S0VMD4C7V7THGnVBvWuGT/WqDwxwE0U5FvT37YMFkDjenRdqViyyC/MJaktkLgOomA3efiahwTPI4xxvchZi7QrXKC3883U2dz52ObQTW+VdJkh3gjxsiL2SD6nw368h+2EGb2ur97WVk3m35SCJdEIfgKbqRGA7QxzHsCXiazSxkHYvwcJXhFJmtQ== hadoop@hadoop002
ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA0z068TIOLr2jKAR9+p/xzwCZiD8ByeETp4AiPlW8JZoBmcWvxMdDUXWJ5Q5nRaUeNtN9i6DxvA6K3zI1yGFSSjwoxaQpJCqxr0tWBCARDqNqkZzHf34nBuIDLcIzhvthxKonVWOeeDws94M+16eN7bwDronfBeJZJYMm7rPV8TMd1rgIK4wUzmva0Ho36HQWU9XKNPVBFwyZPmtP91by98i6X4gcWwVFhEAWeoVOSEl19JJZRlngHbT9o0ZJEAq8a0VEh8IlsqzQIZnvdptE1ZQc1o9+ZBoPcL7n+m/hiqno9WS+mAAsA+yGBuitdZfIEn02GuA3F9S42Mnme88KCw== hadoop@hadoop003
[hadoop@hadoop001 .ssh]$ 

6. 复制 authorized_keys到每个机器的.ssh下

命令:scp authorized_keys root@hadoop002:/home/hadoop/.ssh/

[hadoop@hadoop001 .ssh]$ scp authorized_keys root@hadoop002:/home/hadoop/.ssh/
The authenticity of host 'hadoop002 (172.18.97.106)' can't be established.
RSA key fingerprint is ae:ae:6b:54:2e:96:b8:8a:57:26:04:97:4b:df:36:35.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'hadoop002,172.18.97.106' (RSA) to the list of known hosts.
root@hadoop002's password: 
authorized_keys                                                                                                                 100% 1194     1.2KB/s   00:00    
[hadoop@hadoop001 .ssh]$ scp authorized_keys root@hadoop003:/home/hadoop/.ssh/
The authenticity of host 'hadoop003 (172.18.97.105)' can't be established.
RSA key fingerprint is 66:c6:dc:a6:f5:b7:fb:0a:84:ea:22:e1:e7:5b:81:9d.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'hadoop003,172.18.97.105' (RSA) to the list of known hosts.
root@hadoop003's password: 
authorized_keys                                                                    

7. 更改.ssh文件夹用户/工作组

[hadoop@hadoop001 .ssh]$ su - root
Password: 
[root@hadoop001 ~]# chown -R hadoop:hadoop /home/hadoop/.ssh/*
[root@hadoop001 ~]# chown -R hadoop:hadoop /home/hadoop/.ssh

8. 更改 authorized_keys 权限

[hadoop@hadoop001 .ssh]$ chmod 600 authorized_keys 

9. 测试互相信任

sh hadoop001 date

在每台机器下执行
[hadoop@hadoop002 .ssh]$ ssh hadoop001 date
Mon Nov 26 16:01:21 CST 2018
[hadoop@hadoop002 .ssh]$ ssh hadoop002 date
Mon Nov 26 16:01:25 CST 2018
[hadoop@hadoop002 .ssh]$ ssh hadoop003 date
Mon Nov 26 16:01:30 CST 2018