Oozie报错ClassNotFoundException:…

RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.SparkMain not found
at org.apache.hadoop.conf.Configuration.getClass(Configuration.
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.
at org.apache.hadoop.mapred.MapTask.run(MapTask.
at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.
at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.
at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.
at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.

【解决办法】
一、确保Oozie在hdfs上的sharelib中的spark文件夹下的关于spark的jar都是当前使用版本的。因为oozie编译的时候可能没设定版本,所以会导致不匹配或找不到的问题。(然而它一般只会提示你找不到,这时候脑筋死点就会纠结在为啥有了它却找不到的问题点上,不断的调整路径,以为路径配置错了。桑不起)
二、在oozie-site.xml里面添加如下,令oozie使用hdfs里面的jar库:
    oozie.use.system.libpath
    true

问题汇总: Oozie运行pyspark问题Stack trace: ExitCodeException exitCode=1

参考1、 参考2




你可能感兴趣的:(Oozie报错ClassNotFoundException:…)