hadoop 问题集

1.  org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist

yarn中没有aux的信息。在yarn-site.xml中加入:

  
        yarn.nodemanager.aux-services  
        mapreduce_shuffle  

2. Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

/etc/hadoop/mapred-site.xml 中配置hadoop的安装位置


  yarn.app.mapreduce.am.env
  HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}


  mapreduce.map.env
  HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}


  mapreduce.reduce.env
  HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}

你可能感兴趣的:(hadoop,大数据,分布式)