运行spark程序报错:Failed to locate the winutils binary in the hadoop binary path

在我的win7 idea环境下,运行spark程序,报错:
ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
在这里插入图片描述
看报错信息,应该是在hadoop目录下找不到winutils
于是,百度了一下,发现要下载hadoop-common-2.2.0-bin
去github下载,https://github.com/srccodes/hadoop-common-2.2.0-bin

  • 解压,
  • 配环境变量
    (1)HADOOP_HOME
    D:\software\apache\hadoop-common-2.2.0-bin-master

(2)path
修改path,
%HADOOP_HOME%\bin; 加到前面,注意分号分隔

参考:https://www.cnblogs.com/zq-inlook/p/4386216.html

你可能感兴趣的:(运行spark程序报错:Failed to locate the winutils binary in the hadoop binary path)