SpringBoot+Spark+hadoop环境 maven配置

网上这个配置整合貌似挺少的 自己配了一个 亲测可用

没有用到scala 因为用起来感觉没有用java顺手 直接用了Spark的Java API



	4.0.0

	你项目的名字
	你项目的名字
	1.0-SNAPSHOT

	
		org.springframework.boot
		spring-boot-starter-parent
		2.1.8.RELEASE
	


	
		UTF-8
		2.10
		2.1.0
		2.11.8
		2.7.1
	

	
        
            org.springframework.boot
            spring-boot-starter-web
            
                
                    org.springframework.boot
                    spring-boot-starter-logging
                
            
        
        
            org.springframework.boot
            spring-boot-starter-log4j
        
        
            org.springframework.boot
            spring-boot-starter-test
            test
        
        
            org.springframework.boot
            spring-boot-starter-thymeleaf
        
		
			org.apache.spark
			spark-core_${spark.version}
			${spark_id_version}
		
		
			org.apache.spark
			spark-sql_${spark.version}
			${spark_id_version}
		
		
			org.apache.spark
			spark-hive_${spark.version}
			${spark_id_version}
		
		
			org.apache.spark
			spark-streaming_${spark.version}
			${spark_id_version}
		

		
			org.apache.spark
			spark-streaming-kafka_${spark.version}
			1.3.0
		
		
			org.apache.spark
			spark-mllib_${spark.version}
			${spark_id_version}
		
		
			mysql
			mysql-connector-java
			5.1.39
		
		
			junit
			junit
			4.4
		
        
            org.specs
            specs
            1.2.5
            test
        
        
            org.ansj
            ansj_seg
            5.1.1
        


		
		
			org.apache.hadoop
			hadoop-client
			${hadoop.version}
		
		
			org.apache.hadoop
			hadoop-common
			${hadoop.version}
		
		
			org.apache.hadoop
			hadoop-hdfs
			${hadoop.version}
		

	




	
	
		
			central
			Central Repository
			http://maven.aliyun.com/nexus/content/repositories/central
			default
			
				false
			
		

	

	
		src/main/java

		src/test/java

		
			
				
				org.apache.maven.plugins
				maven-compiler-plugin
				3.3
				
					1.8
					1.8
					UTF-8


				

			
            
                org.springframework.boot
                spring-boot-maven-plugin
            
            
                org.apache.maven.plugins
                maven-compiler-plugin
                
                    1.8
                    1.8
                
            
		
	

 

你可能感兴趣的:(Spark)