spark的maven项目的pom文件

具体的maven项目的pom文件的内容见：https://mvnrepository.com/
注： 在2.0以前创建spark的入口对象是通过sparkconf,sparkcontext来创建sc的，2.0以后是次啊用的sparkSession作为spark的唯一入口。并且spark2.2的版本是需要jdk1.8的。

这里是引用

 
    1.8
    1.8
    2.10.5
    1.6.2
    2.6.4
    UTF-8
 
 

      
    
        org.scala-lang
        scala-library
        ${scala.version}
    
    
    
        org.apache.spark
        spark-core_2.11
        ${spark.version}
    
    
        org.apache.spark
        spark-sql_2.11
        ${spark.version}
    
        
          
    	org.apache.spark      
    	spark-hive_2.11      
    	${spark.version}    
    
      
    
        org.apache.hadoop
        hadoop-client
        ${hadoop.version}
    



    
        
            
            
                net.alchim31.maven
                scala-maven-plugin
                3.2.2
            
            
            
                org.apache.maven.plugins
                maven-compiler-plugin
                3.5.1
            
        
    
    
        
            net.alchim31.maven
            scala-maven-plugin
            
                
                    scala-compile-first
                    process-resources
                    
                        add-source
                        compile
                    
                
                
                    scala-test-compile
                    process-test-resources
                    
                        testCompile
                    
                
            
        

        
            org.apache.maven.plugins
            maven-compiler-plugin
            
                
                    compile
                    
                        compile
                    
                
            
        
        
        
            org.apache.maven.plugins
            maven-shade-plugin
            2.4.3
            
                
                    package
                    
                        shade
                    
                    
                        
                            
                                *:*
                                
                                    META-INF/*.SF
                                    META-INF/*.DSA
                                    META-INF/*.RSA