(已解决)执行spark-submit报错ERROR MapOutputTracker:70 - Missing an output location for shuffle 176

问题

执行spark-submit报错ERROR MapOutputTracker:70 - Missing an output location for shuffle 176和Job aborted due to stage failure: ShuffleMapStage 512 (map at MovieLensALS.scala:144) has failed the maximum allowable number of times: 4.
(已解决)执行spark-submit报错ERROR MapOutputTracker:70 - Missing an output location for shuffle 176_第1张图片

解决

更改分区:spark-submit命令后加上--conf spark.sql.shuffle.partitions=520,具体数字取决于报错提示
在这里插入图片描述

你可能感兴趣的:(大数据,spark,scala,大数据)