1.2.4 大数据2.x 集群安装系列-- 集群配置中的用户及取消授权

1、现象

Permission denied: user=dr.who

2、解决

3、配置

mapred-site

<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
    <property>
        <name>mapreduce.jobhistory.address</name>
        <value>bigdata-pro01.kfk.com:10020</value>
    </property>
    <property>
        <name>mapreduce.jobhistory.webapp.address</name>
        <value>bigdata-pro01.kfk.com:19888</value>
    </property>
</configuration>

hdfs-site

<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
   <property>
        <name>mapreduce.jobhistory.address</name>
        <value>bigdata-pro01.kfk.com:10020</value>
    </property>
    <property>
        <name>mapreduce.jobhistory.webapp.address</name>
        <value>bigdata-pro01.kfk.com:19888</value>
    </property>
</configuration>

core-site

<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://bigdata-pro01.kfk.com:9000</value>
    </property>
 
    <property>
        <name>hadoop.http.staticuser.user</name>
        <value>kfk</value>
    </property>
 
    <property>
        <name>hadoop.tmp.dir</name>
        <value>/opt/modules/hadoop-2.5.0/data/tmp</value>
    </property>                        
</configuration>

[kfk@bigdata-pro01 hadoop-2.5.0]$ mkdir -p data/tmp
[kfk@bigdata-pro01 hadoop-2.5.0]$ cd data/tmp
[kfk@bigdata-pro01 tmp]$ pwd
/opt/modules/hadoop-2.5.0/data/tmp

4、开始分发

先停 2.3服务 忘记了 用kill 才能删干净

sbin/mr-jobhistory-daemon.sh stop historyserver
sbin/yarn-daemon.sh stop nodemanager
sbin/yarn-daemon.sh stop resourcemanager
sbin/hadoop-daemon.sh stop datanode
sbin/hadoop-daemon.sh stop namenode

[kfk@bigdata-pro02 modules]$ cd /opt/modules/
[kfk@bigdata-pro02 modules]$ rm -rf hadoop-2.5.0/
 
[kfk@bigdata-pro03 modules]$ cd /opt/modules/
[kfk@bigdata-pro03 modules]$ rm -rf hadoop-2.5.0/
 
scp -r hadoop-2.5.0/ kfk@bigdata-pro02.kfk.com:/opt/modules/
scp -r hadoop-2.5.0/ kfk@bigdata-pro03.kfk.com:/opt/modules/

5、启动测试

bin/hdfs namenode -format
sbin/hadoop-daemon.sh start namenode
sbin/hadoop-daemon.sh start datanode
sbin/yarn-daemon.sh start resourcemanager
sbin/yarn-daemon.sh start nodemanager
sbin/mr-jobhistory-daemon.sh start historyserver

查看HDFS Summary
Security is off.
Safemode is off.
来自 http://bigdata-pro01.kfk.com:50070/dfshealth.html#tab-overview

查看YARN