大数据IMF传奇行动 scala IDE 本地local开发wordcount 无法加载主类问题解决
大数据IMF传奇行动
安装工具存放的目录
G:\IMFBigDataSpark2016\Bigdata_Software
1、scala IDE 4.3.0 下载页面 scala-SDK-4.3.0-vfinal-2.11-win32.win32.x86
http://scala-ide.org/download/sdk.html
部署在 G:\IMFBigDataSpark2016\eclipse\eclipse.exe
2、原来的是java 1.7.0_13 重新下载 java1.8
windows版本
下载页面 jdk-8u65-windows-i586.exe
http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
部署 C:\Program Files\Java\jdk1.8.0_65
linux版本 jdk-8u65-linux-i586.gz
下载页面
http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
设置java_home 和path
C:\Users\admin>java -version
java version "1.8.0_65"
Java(TM) SE Runtime Environment (build 1.8.0_65-b17)
Java HotSpot(TM) Client VM (build 25.65-b01, mixed mode)
3、scala 版本为 2.10.4 已经具备
C:\Users\admin>scala -version
Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
4、新建工程,默认scala库是2.11.7要手动换版本 2.10.x ok
5、加入spark 1.6.0 jar依赖
进入官网http://spark.apache.org/
1.6.0版本 prebuild for hadoop 2.6
Download Spark: spark-1.6.0-bin-hadoop2.6.tgz
6\spark-1.6.0-bin-hadoop2.6.tgz
http://www.apache.org/dyn/closer.lua/spark/spark-1.6.0/spark-1.6.0-bin-hadoop2.6.tgz
点击下载
http://apache.opencas.org/spark/spark-1.6.0/spark-1.6.0-bin-hadoop2.6.tgz
7、找到依赖spark文件导入
G:\IMFBigDataSpark2016\Bigdata_Software\spark-1.6.0-bin-hadoop2.6\spark-1.6.0-bin-hadoop2.6\spark-1.6.0-bin-hadoop2.6\lib、spark-assembly-1.6.0-hadoop2.6.0.jar
8、导入spark 包
9、在src中建立工程包com.dt.spark
找不到或无法加载主类
%java_home%\bin;%java_home%\jre\bin;
.;%java_home%\lib;%java_home%\lib\tools.jar
1、问题描述：
根据第八课内容实践，提示编译错误：在scala IDE 4.3.0中新建工程WordCount,已将scala库从2.11.7手动换版本 2.10.x（显示2.10.6），已经导入spark jar包spark-1.6.0-bin-hadoop2.6.tgz依赖,新建WordCount.scala，编译运行提示错误:无法加载主类 com.dt.spark.WordCount
Description Location Resource Path Type
More than one scala library found in the build path (G:/IMFBigDataSpark2016/eclipse/plugins/org.scala-ide.scala210.jars_4.3.0.201512011535/target/jars/scala-library.jar, G:/IMFBigDataSpark2016/Bigdata_Software/spark-1.6.0-bin-hadoop2.6/spark-1.6.0-bin-hadoop2.6/spark-1.6.0-bin-hadoop2.6/lib/spark-assembly-1.6.0-hadoop2.6.0.jar).At least one has an incompatible version. Please update the project build path so it contains only one compatible scala library. Unknown WordCount Scala Classpath Problem
2、详细过程：
1、Windows 7 上java、scala配置
C:\Users\admin>java -version
java version "1.8.0_65"
Java(TM) SE Runtime Environment (build 1.8.0_65-b17)
Java HotSpot(TM) Client VM (build 25.65-b01, mixed mode)
C:\Users\admin>scala -version
Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
3、问题截图：
处理过程：刷新环境变量，在scala IDE 4.3.0重新运行，还是编译提示错误。
%java_home%\bin;%java_home%\jre\bin;
.;%java_home%\lib;%java_home%\lib\tools.jar
是否需要更新scala版本？
问题解决：设置为fix
在Scala Compiler中
设置 Scala Installation 为 Fixed Scala Installation:2.10.6(built-in)
编译无法加载主类 com.dt.spark.WordCount的问题已经解决.谢谢