spark: ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
winutils
Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)
项目地址:https://gitcode.com/gh_mirrors/wi/winutils
免费下载资源
·
一、问题
下载spark-2.0.0-bin-hadoop2.7.tgz 后,在C:\spark\bin 运行spark-shell.cmd 时, 报错
ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:318)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:333)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:326)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:76)
二、解决办法
1. 下载 winutils.exe 放到 c:\hadoop\bin
2. 设置环境变量
HADOOP_HOME=c:\hadoop
PATH=%HADOOP_HOME%\bin
3. 在C:\spark\bin 右键 以管理员运行 spark-shell.cmd
GitHub 加速计划 / wi / winutils
2.51 K
3 K
下载
Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)
最近提交(Master分支:1 个月前 )
e8089ecf - 1 年前
d4f71517
point people at cdarlint/winutils for binaries and call out the fact that we could remove the need for this entirely just to run spark on windows 5 年前
更多推荐
已为社区贡献4条内容
所有评论(0)