spark2.3.1+jdk1.8向下兼容1.7(生产机器为jdk1.7)

1、打包


    org.apache.spark
    spark-core_2.11
    ${spark.version}
    
    provided


    org.apache.spark
    spark-sql_2.11
    ${spark.version}
    
    provided

2、上传到生产集群/opt/core/spark-2.3.1-bin-hadoop2.6/bin/spark-submit --class com.jiupaipay.wordcount.WordCount --master local[*] ./sparkwordcount-1.0-SNAPSHOT-jar-with-dependencies.jar

/opt/core/spark-2.3.1-bin-hadoop2.6/bin/spark-submit --queue root.line.pay --class com.jiupaipay.wordcount.WordCount --master yarn-client ./sparkwordcount-1.0-SNAPSHOT-jar-with-dependencies.jar

你可能感兴趣的:(spark)