Apache Hudi源码编译

1.安装Maven

在Linux 版本64位操作上下载和安装Maven，直接将Maven软件包解压，然后配置系统环境变量即可。Maven版本为：3.9.3

1. 从 maven官网下载maven安装包,然后执行解压即可

tar -zxvf apache-maven-3.9.3-bin.tar.gz
mv apache-maven-3.9.3-bin maven

在maven解压后的目录下创建data目录

cd apache-maven-3.9.3-bin
mkdir data

2. 配置maven配置文件

vim conf/settings.xml

<localRepository>/home/sjyy/app/maven/datalocalRepository>


<mirror>
    <id>alimavenid>
    <name>aliyun mavenname>
    <url>http://maven.aliyun.com/nexus/content/groups/public/url>
    <mirrorOf>centralmirrorOf>
mirror>
<mirror>
    <id>aliyunmavenid>
    <mirrorOf>*mirrorOf>
    <name>阿里云spring插件仓库name>
    <url>https://maven.aliyun.com/repository/spring-pluginurl>
mirror>
<mirror>
    <id>repo2id>
    <name>Mirror from Maven Repo2name>
    <url>https://repo.spring.io/plugins-release/url>
    <mirrorOf>centralmirrorOf>
mirror>
<mirror>
    <id>UKid>
    <name>UK Centralname>
    <url>http://uk.maven.org/maven2url>
    <mirrorOf>centralmirrorOf>
mirror>
<mirror>
    <id>jboss-public-repository-groupid>
    <name>JBoss Public Repository Groupname>
    <url>http://repository.jboss.org/nexus/content/groups/publicurl>
    <mirrorOf>centralmirrorOf>
mirror>
<mirror>
    <id>CNid>
    <name>OSChina Centralname>
    <url>http://maven.oschina.net/content/groups/public/url>
    <mirrorOf>centralmirrorOf>
mirror>
<mirror>
    <id>google-maven-centralid>
    <name>GCS Maven Central mirror Asia Pacificname>
    <url>https://maven-central-asia.storage-download.googleapis.com/maven2/url>
    <mirrorOf>centralmirrorOf>
mirror>
<mirror>
    <id>confluentid>
    <name>confluent mavenname>
    <url>http://packages.confluent.io/maven/url>
    <mirrorOf>confluentmirrorOf>
mirror>

3. 配置环境变量

vim ~/.bashrc
	
export MAVEN_HOME=/home/sjyy/app/maven
export PATH=$MAVEN_HOME/bin:$PATH

# 使得环境变量生效
source ~/.bashrc

# 测试安装是否成功
mvn -version

查看到以下界面则表示安装成功

2.下载源码包

从Apache Hudi官网下载源码包,版本为0.13.0

1. 解压文件

tar -zxvf hudi-0.13.1.src.tgz
mv hudi-0.13.1 hudi

进入到hudi目录下执行mvn编译命令

cd hudi

mvn clean install -DskipTests -DskipITs -Dscala-2.12 -Dspark3

等待编译完成即可。