Previous writer likely failed to write hdfs://hadoop001:8020/tmp/hive/root/_tez...... Failing becaus

Logging initialized using configuration in file:/etc/hive/2.5.0.0-1245/0/hive-log4j.properties
[color=#FF0000]Exception in thread “main” java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://nn01:8020/tmp/hive/root/_tez_session_dir/80a3d39c-82a7-4710-b768-f6c17c19a0a4/hive-hcatalog-core.jar. Failing because I am unlikely to write too.
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:536)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:680)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:624)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.io.IOException: Previous writer likely failed to write hdfs://dev-001-hdpnn01:8020/tmp/hive/root/_tez_session_dir/80a3d39c-82a7-4710-b768-f6c17c19a0a4/hive-hcatalog-core.jar. Failing because I am unlikely to write too.
at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:985)
at org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:865)
at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:808)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.refreshLocalResourcesFromConf(TezSessionState.java:233)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:158)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:117)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:533

解决方法:查看hive/conf/hive-env.sh文件,看如下的lzo配置是否与/opt/module/hadoop-3.2.2/share/hadoop/common/路径下的lzo的jar包一致。

export HIVE_AUX_JARS_PATH=/opt/module/hadoop-3.2.2/share/hadoop/common/hadoop-lzo-0.4.20.jar$TEZ_JARS

你可能感兴趣的:(hadoop,mapreduce,hdfs)