java.lang.IllegalArgumentException: System memory ... must be at least ... Please use a larger heap

java.lang.IllegalArgumentException: System memory 259522560 must be at least 4.718592E8. Please use a larger heap size.

java.lang.IllegalArgumentException: System memory ... must be at least ... Please use a larger heap_第1张图片

解决:

设置应用程序的 VM options

idea的设置路径在:Run -Edit Configurations-Application选择对应的程序,设置VM options,如下:

-Xms256m -Xmx1024m

java.lang.IllegalArgumentException: System memory ... must be at least ... Please use a larger heap_第2张图片

scala ide下的设置为:

eclispe 中window->preferences->Java->Installed JRE ,点击右侧的Edit 按钮,在编辑界面中的 “Default VM Arguments ”选项中,编辑。

could not locate executable **winutils.exe in the Hadoop binaries

windows环境下,解决:could not locate executable **winutils.exe in the Hadoop binaries.问题:

ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable E:\hadoop-2.6.3\bin\winutils.exe in the Hadoop binaries.

java.lang.IllegalArgumentException: System memory ... must be at least ... Please use a larger heap_第3张图片

解决:将winutils.exe文件导入到对应Hadoop的bin目录下面去,就搞定!(放到HADOOP_HOME对应的hadoop版本目录下面)

java.lang.IllegalArgumentException: System memory ... must be at least ... Please use a larger heap_第4张图片

你可能感兴趣的:(spark,heap-size)