spark利用yarn提交任务报:YARN application has exited unexpectedly with state UNDEFINED

spark用yarn提交任务会报
ERROR cluster.YarnClientSchedulerBackend: YARN application has exited unexpectedly with state UNDEFINED! Check the YARN application logs for more details.
ERROR cluster.YarnClientSchedulerBackend: Diagnostics message: Shutdown hook called before final status was reported.

只需要将hadoop集群的yarn-site.xml配置中加入如下两行即可解决:


    yarn.nodemanager.pmem-check-enabled
    false


    yarn.nodemanager.vmem-check-enabled
    false

如果你用的java8,则多会报此错误。

你可能感兴趣的:(spark利用yarn提交任务报:YARN application has exited unexpectedly with state UNDEFINED)