YARN常见文件汇总

1

hive> select count(*) from kylin_sales limit 10;
Query ID = root_20181108175454_275f4f71-f877-43e0-8d51-b9b53a439a4b
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=
In order to set a constant number of reducers:
  set mapreduce.job.reduces=
java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_154167062 YARN : Application rejected by queue placement policy
        at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:336)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)

排查问题
1.上面的报错与队列相关
2.CDH yarn界面问题排查队列生成的样子异常

解决方法：配置yarn动态资源池