Hive提交任务FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

Query ID = root_20191114010024_e70138f9-544a-4cd7-86a1-58fd1054cd6a
Total jobs = 2
Launching Job 1 out of 2
Number of reduce tasks not specified. Estimated from input data size: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=
In order to set a constant number of reducers:
  set mapreduce.job.reduces=
Starting Job = job_1573652582737_0011, Tracking URL = http://henu3:8088/proxy/application_1573652582737_0011/
Kill Command = /opt/hadoop-2.6.5/bin/hadoop job  -kill job_1573652582737_0011
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2019-11-14 01:00:49,725 Stage-1 map = 0%,  reduce = 0%
2019-11-14 01:01:03,897 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.68 sec
2019-11-14 01:01:14,579 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 1.68 sec
MapReduce Total cumulative CPU time: 1 seconds 680 msec
Ended Job = job_1573652582737_0011 with errors
Error during job, obtaining debugging information...
Examining task ID: task_1573652582737_0011_m_000000 (and more) from job job_1573652582737_0011

Task with the most failures(4): 
-----
Task ID:
  task_1573652582737_0011_r_000000

URL:
  http://0.0.0.0:8088/taskdetails.jsp?jobid=job_1573652582737_0011&tipid=task_1573652582737_0011_r_000000
-----
Diagnostic Messages for this Task:
Container launch failed for container_1573652582737_0011_01_000006 : org.apache.hadoop.yarn.exceptions.YarnException: Unauthorized re
quest to start container. This token is expired. current time is 1574278713422 found 1573665189987
Note: System times on machines may be out of sync. Check system time and time zones.
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:1
68)	at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
	at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)
	at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:369)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched: 
Stage-Stage-1: Map: 1  Reduce: 1   Cumulative CPU: 1.68 sec   HDFS Read: 146679 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 1 seconds 680 msec

不耽误大家时间,我直接说解决方案。我真是万万没想到。

搞了半天,我以为还是内存的问题,还把数据量减少,然后还是会报出

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
然后经过查资料,然后日志并看不出什么。

最后看了一下自己的集群各节点时间  date

竟然不一致,忘了这一套集群没有设置更新时间。

然后date -s "时间"

重启集群

重新提交

ok!!!

希望对你也是有用。。。

Hive提交任务FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask_第1张图片

你可能感兴趣的:(#,bigdata_异常处理)