基于HDP（ambari）的Flink1.9.0编译

我在网上一直没有找到基于HDP-Flink1.9编译的文档，这几天一直在研究，踩了不少坑，现在整理一下，希望可以帮到大家

 

一、准备

1.安装Apache Maven 3.2.5

2.下载flink-shaded-7.0

3.下载flink-release-1.9.0

 

二、准备编译

1.修改flink-shaded项目中的pom.xml，添加如下

把上述内容加入到 里面去。

	vendor-repos
	
		
			vendor-repos
		
	
	
	
		
		
			cloudera-releases
			https://repository.cloudera.com/artifactory/cloudera-repos
			
				true
			
			
				false
			
		
		
		
			HDPReleases
			HDP Releases
			https://repo.hortonworks.com/content/repositories/releases/
			false
			true
		
		
			HortonworksJettyHadoop
			HDP Jetty
			https://repo.hortonworks.com/content/repositories/jetty-hadoop
			false
			true
		
		
		
			mapr-releases
			https://repository.mapr.com/maven/
			false
			true
		
	

2.编译flink-shaded-hadoop-2（我hadoop的版本为3.1.0.3.0.0.0-1634）

mvn  clean install -DskipTests -Drat.skip=true -Pvendor-repos  -Dhadoop.version=3.1.0.3.0.0.0-1634

备注：如果途中报错，jar无法下载的话，手动导入到Maven仓库中

 

3.在flink-release-1.9.0中修改pom文件，添加如下

	vendor-repos
	
		
			vendor-repos
		
	
	
	
		
		
			cloudera-releases
			https://repository.cloudera.com/artifactory/cloudera-repos
			
				true
			
			
				false
			
		
		
		
			HDPReleases
			HDP Releases
			https://repo.hortonworks.com/content/repositories/releases/
			false
			true
		
		
			HortonworksJettyHadoop
			HDP Jetty
			https://repo.hortonworks.com/content/repositories/jetty-hadoop
			false
			true
		
		
		
			mapr-releases
			https://repository.mapr.com/maven/
			false
			true
		
	

5.编译flink-1.9

mvn clean install -DskipTests -Pvendor-repos -Drat.skip=true -Pinclude-hadoop -Dhadoop.version=3.1.0.3.0.0.0-1634

 

完成