整理了maven中基于spark-2.3.1常用的依赖和插件



    4.0.0

    com.baidukt
    spark
    1.0-SNAPSHOT

   jar

    
        1.8
        1.8
        2.11.12
        2.3.1
        2.7.6
        2.0.1
        2.0.1
        UTF-8
    

    
        
        
            org.scala-lang
            scala-library
            ${scala.version}
        
        
        
            org.apache.spark
            spark-core_2.11
            ${spark.version}
        
        
        
            org.apache.spark
            spark-sql_2.11
            ${spark.version}
        
        
        
            org.apache.spark
            spark-graphx_2.11
            ${spark.version}
        

        
        
        
            org.apache.spark
            spark-streaming_2.11
            ${spark.version}
        
        
        
            org.apache.spark
            spark-streaming-kafka-0-10_2.11
            ${spark.version}
        
        
        
            org.apache.kafka
            kafka-clients
            ${kafka-clients.version}
        
        
            org.apache.kafka
            kafka-streams
            ${kafka-streams.version}
        
        

        
        
        
            org.apache.spark
            spark-hive_2.11
            ${spark.version}
        
        
            org.apache.hbase
            hbase-common
            2.0.1
        
        
            org.apache.hbase
            hbase-client
            2.0.1
        
        
            org.apache.hbase
            hbase-server
            1.2.3
        
        
            org.apache.hbase
            hbase
            2.0.1
            pom
        
        

        
        
            org.apache.hadoop
            hadoop-client
            ${hadoop.version}
        
        
            org.apache.hadoop
            hadoop-hdfs
            ${hadoop.version}
        

        
        
            org.apache.zookeeper
            zookeeper
            3.4.10
        
        
        
            redis.clients
            jedis
            2.9.0
        
        
            log4j
            log4j
            1.2.17
        
        
            com.typesafe
            config
            1.3.0
        
        
            commons-httpclient
            commons-httpclient
            3.1
        
        
            com.alibaba
            fastjson
            1.2.35
        
        
            ch.hsr
            geohash
            1.3.0
        
        
            mysql
            mysql-connector-java
            5.1.47
        
    

    
        
            
                
                
                    
                    
                    
                
                
                
                    org.apache.maven.plugins
                    maven-compiler-plugin
                    3.8.0
                    
                    
                        1.8
                        1.8
                    
                
            
        

        
            
                
                
                
                
                    
                        
                        
                        
                            
                            
                        
                    
                    
                        
                        
                        
                            
                        
                    
                
            

            
                org.apache.maven.plugins
                maven-compiler-plugin
                3.8.0
                
                    
                        compile
                        
                            compile
                        
                    
                
            

              
            
                org.apache.maven.plugins
                maven-shade-plugin
                3.2.1
                
                    
                        package
                        
                            shade
                        
                        
                            
                                
                                    *:*
                                    
                                        META-INF/*.SF
                                        META-INF/*.DSA
                                        META-INF/*.RSA
                                    
                                
                            
                        
                    
                
            
        
    

 

转载于:https://my.oschina.net/u/3962987/blog/3098498

你可能感兴趣的:(整理了maven中基于spark-2.3.1常用的依赖和插件)