spark on yarn idea错误: 找不到或无法加载主类org.apache.spark.deploy.yarn.ExecutorLauncher

  • spark on yarn idea远程提交报错,查看8088日志发现

spark on yarn idea错误: 找不到或无法加载主类org.apache.spark.deploy.yarn.ExecutorLauncher_第1张图片
  • 设置sparkconf的"spark.yarn.jars"属性后解决第一个为你的jar包名称,第二个为spark依赖的jar包目录

.set("spark.yarn.jars", "C:\\Users\\han\\Desktop\\test\\dns_project\\target\\dns_project.jar,hdfs://dsy:9000/spark-yarn/jars/*.jar")
spark on yarn idea错误: 找不到或无法加载主类org.apache.spark.deploy.yarn.ExecutorLauncher_第2张图片

重新运行后成功解决,虽然报了其他错... 但总算找到了类

你可能感兴趣的:(bug,spark,大数据,intellij-idea,yarn)