hadoop2.7.1安装部署错误,求大神指导

环境,三台虚拟机,centos6.5,jdk 1.7.0_71,hadoop版本hadoop2.7.1

三台机分别配置/etc/sysconfig/network 为

NETWORKING=yes
HOSTNAME=master 

NETWORKING=yes
HOSTNAME=master2

NETWORKING=yes
HOSTNAME=master3

配置/etc/hosts
192.168.244.102   master
192.168.244.104   master3
192.168.244.105   master2
127.0.0.1  localhost.localdomain master

192.168.244.102   master
192.168.244.104   master3
192.168.244.105   master2
127.0.0.1  localhost.localdomain master2

192.168.244.102   master
192.168.244.104   master3
192.168.244.105   master2
127.0.0.1  localhost.localdomain master3

配置core-site.xml


   
        fs.defaultFS
        hdfs://master:9000
   

   
     hadoop.tmp.dir  
     /home/hadoop/hadooptmp  
 
 
 
     io.file.buffer.size
     131072
 


配置hdfs-site.xml


   
        dfs.replication
        3
   

   
     dfs.namenode.secondary.http-address
     master:9001
   

 
  dfs.namenode.name.dir  
  file:/home/hadoop/hdfs/name  
 
   
   
  dfs.datanode.data.dir  
  file:/home/hadoop/hdfs/data  
 

   
dfs.webhdfs.enabled
true
   



配置mapred-site.xml



        mapreduce.framework.name
        yarn
   


  mapreduce.jobhistory.address 
master:10020
 

 
mapreduce.jobhistory.webapp.address
master:19888
 



配置yarn-site.xml 




 
        yarn.nodemanager.aux-services
        mapreduce_shuffle
   

                                                                   
yarn.nodemanager.aux-services.mapreduce.shuffle.class
               org.apache.hadoop.mapred.ShuffleHandler
       

       
               yarn.resourcemanager.address
               master:8032
       

       
               yarn.resourcemanager.scheduler.address
               master:8030
       

       
            yarn.resourcemanager.resource-tracker.address
             master:8031
     

     
              yarn.resourcemanager.admin.address
               master:8033
       

       
               yarn.resourcemanager.webapp.address
               master:8088
       




hadoop-env.sh、yarn-env.sh,mapred-env.sh 的JAVA_HOME 配置为

export JAVA_HOME=/usr/java/jdk1.7.0_71

slaves配置为

master2
master3

使用命令sbin/start-dfs.sh;sbin/start-yarn.sh 启动

主节点jps查看不到任何信息

但是搜索进程 (ps -ef|grep java)可以看到

hadoop    1214     1  0 19:42 ?        00:00:12 /usr/java/jdk1.7.0_71/bin/java -Dproc_namenode -Xmx1000m -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop/hadoop-2.7.1/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/hadoop/hadoop/hadoop-2.7.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/hadoop/hadoop/hadoop-2.7.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop/hadoop-2.7.1/logs -Dhadoop.log.file=hadoop-hadoop-namenode-master.log -Dhadoop.home.dir=/home/hadoop/hadoop/hadoop-2.7.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/home/hadoop/hadoop/hadoop-2.7.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.NameNode
hadoop    1394     1  0 19:42 ?        00:00:08 /usr/java/jdk1.7.0_71/bin/java -Dproc_secondarynamenode -Xmx1000m -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop/hadoop-2.7.1/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/hadoop/hadoop/hadoop-2.7.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/hadoop/hadoop/hadoop-2.7.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop/hadoop-2.7.1/logs -Dhadoop.log.file=hadoop-hadoop-secondarynamenode-master.log -Dhadoop.home.dir=/home/hadoop/hadoop/hadoop-2.7.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/home/hadoop/hadoop/hadoop-2.7.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode
hadoop    1956  1033  0 20:12 pts/0    00:00:00 grep java

在master3上面jps命令 打印

1067 DataNode
1297 Jps


在master2上面jps命令 打印

1153 NodeManager
1065 DataNode
1295 Jps

查看主节点日志 其他文件均正常,除了yarn-hadoop-resourcemanager-master.log 有错误信息

vi yarn-hadoop-resourcemanager-master.log 

2015-12-02 19:42:38,272 ERROR org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
2015-12-02 19:42:38,272 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to standby state
2015-12-02 19:42:38,272 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
        at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:279)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:974)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:1074)
        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1208)
Caused by: java.io.IOException: Unable to initialize WebAppContext
        at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:879)
        at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:274)
        ... 4 more
Caused by: java.io.FileNotFoundException: /tmp/Jetty_master_8088_cluster____i4ls4w/webapp/webapps/cluster/.keep (No such file or directory)
        at java.io.FileOutputStream.open(Native Method)
        at java.io.FileOutputStream.(FileOutputStream.java:221)
        at java.io.FileOutputStream.(FileOutputStream.java:171)
        at org.mortbay.resource.JarResource.extract(JarResource.java:215)
        at org.mortbay.jetty.webapp.WebAppContext.resolveWebApp(WebAppContext.java:974)
        at org.mortbay.jetty.webapp.WebAppContext.getWebInf(WebAppContext.java:832)
        at org.mortbay.jetty.webapp.WebInfConfiguration.configureClassLoader(WebInfConfiguration.java:62)
        at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:489)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:857)
        ... 5 more
2015-12-02 19:42:38,277 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at master/127.0.0.1
************************************************************/

求各位指导!!!

你可能感兴趣的:(hadoop2.7.1安装部署错误,求大神指导)