kafka结合spark 错误整理

1. 

Error:scalac: bad symbolicreference. A signature in KafkaUtils.class refers to term serializerin package kafka which isnot available.It may be completely missing fromthe current classpath, ortheversiononthe classpath might be incompatible withtheversion used when compiling KafkaUtils.class.


解决方法:

缺少kafka_2.10-0.8.2.0-kafka-1.4.0.jar

2.java.lang.ClassNotFoundException: org.apache.spark.streaming.kafka.KafkaRDDPartition

解决:

 spark-submit --class  sparkstreaming.KafkaStreaming   --master spark://bihdp01:7077  --executor-memory 1G --total-executor-cores 1 (未指定前两个)  /data/peng/spark.jar 






你可能感兴趣的:(kafka结合spark 错误整理)