spark报错集锦

1.spark报错信息:

org.apache.spark.SparkException: Job aborted due to stage failure: Task 5 in stage 2.0 failed 4 times, most recent failure: Lost task 5.3 in stage 2.0 (TID 227, dhpnm236-192-064, executor 25): ExecutorLostFailure (executor 25 exited caused by one of the running tasks) Reason: Container from a bad node: container_e98_1651843250015_1453361_01_000028 on host: dhpnm236-192-064. Exit status: 143. 
Diagnostics: Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
Killed by external signal

问题:资源不足;

解决方案:增大job可用内存或调整代码;

你可能感兴趣的:(spark报错集锦,spark,big,data,大数据)