关于 structuredstreaming消费kafka中的异常汇总

本人的spark是2.2.4的，kafka是0.10的，遇到了以下问题，后续会持续更新

1、Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, Failed to find data source: kafka. Please find packages at http://spark.apache.org/third-party-projects.html java.lang.ClassNotFoundException: Failed to find data source: kafka. Please find packages at http://spark.apache.org/third-party-projects.html

Caused by: java.lang.ClassNotFoundException: kafka.DefaultSource

原因是确少了sparksql跟kafka整合的包，只需添加一下依赖即可

    org.apache.spark
    spark-sql-kafka-0-10_2.11
    2.2.0

 2、Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.serialization.ByteArrayDeserializer

原因是缺少了kafka的client包，添加以下依赖即可

 
            org.apache.kafka
            kafka_2.12
            0.10.2.2