java.lang.ClassNotFoundException: org.apache.spark.sql.internal.StaticSQLConf$

Bug描述:


Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/sql/internal/StaticSQLConf$
	at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:938)
	at ps_overview.Kafka_To_Hive$.main(Kafka_To_Hive.scala:33)
	at ps_overview.Kafka_To_Hive.main(Kafka_To_Hive.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.spark.sql.internal.StaticSQLConf$
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:355)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
	... 3 more

已解决方案:

         
            org.apache.spark
            spark-catalyst_2.11 //此处版本是对应的scala版本2.11.8
            ${spark.version} //我的是spark2.3.1
            compile  //特别注意这里要使用compile
         

 

你可能感兴趣的:(Spark)