Apache Atlas 2.1.0编译打包安装记录

一、Apache Atlas简介

Atlas 是一个可伸缩和可扩展的核心基础数据治理服务集合 ，使企业能够有效地和高效地满足 Hadoop 中的合规性要求，并允许与整个企业数据生态系统的集成。

项目地址：
https://github.com/apache/atlas

详细介绍:
https://blog.csdn.net/qq_38247150/article/details/108756790

二、编译打包

版本
Apache Atlas 2.1.0
Apache Maven 3.6.3
JDK 1.8
Python 2.7.18
Ubuntu 20.04.2 LTS

注意：
不建议使用win10打包！！！
语言方面jdk必须是1.8！！！
python必须是2.7！！！

笔者使用的是win10的WSL2打包的

---

Apache Atlas不提供安装包，需要自己下载源码打包。

1 打开官网下载源码

官网地址：
https://atlas.apache.org/2.1.0/index#/Downloads
笔者这里下载2.1.0的source

wget https://www.apache.org/dyn/closer.cgi/atlas/2.1.0/apache-atlas-2.1.0-sources.tar.gz

2 解压

tar -zxvf apache-atlas-2.1.0-sources.tar.gz

3 打包

3.1 打包前的准备

# 进入打包后的目录
cd apache-atlas-sources-2.1.0

# 设置maven打包进程的jvm参数。（-Xms表示初始化JAVA堆的大小及该进程刚创建出来的时候，他的专属JAVA堆的大小，一旦对象容量超过了JAVA堆的初始容量，JAVA堆将会自动扩容到-Xmx大小）
export MAVEN_OPTS="-Xms3g -Xmx3g"

3.2 执行打包命令

如果环境中已经有装好Apache Hbase和Apache Solr，执行这条

mvn clean -DskipTests package -Pdist

如果环境中没有Hbase和Solr，希望使用Atlas内置的Hbase和Solr，执行这条；
笔者这里没有hadoop环境，只好使用这条命令了。

mvn clean -DskipTests package -Pdist,embedded-hbase-solr

如果希望使用Atlas内置的Apache Cassandra 和 Apache Solr，执行这条命令

mvn clean package -Pdist,embedded-cassandra-solr

打包过程要下很多jar包和node安装包，速度快慢看网络速度，网络慢或者有波动的话下载会中断，需要要多重试几次。

打包过程中会下载node安装包，如果有代理可以手动提前下载好放到指定目录，这样会快不少。

[INFO] Installing node version v12.16.0
[INFO] Downloading https://nodejs.org/dist/v12.16.0/node-v12.16.0-linux-x64.tar.gz to /root/.m2/repository/com/github/eirslett/node/12.16.0/node-12.16.0-linux-x64.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly

3.3 打包报错

Too many files with unapproved license

[ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.13:check (rat-check) on project apache-atlas: Too many files with unapproved license: 1274 See RAT report in: /opt/soft/apache-atlas-sources-2.1.0/target/rat.txt -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :apache-atlas

检查license报错，添加参数-Drat.skip=true跳过license检查。再次执行命令

# 修改前命令
mvn clean -DskipTests package -Pdist,embedded-hbase-solr

# 修改后命令
mvn clean -DskipTests package -Pdist,embedded-hbase-solr -Drat.skip=true

最后，终于打包成功了

[INFO] Apache Atlas Server Build Tools 1.0 ................ SUCCESS [  0.511 s]
[INFO] apache-atlas 2.1.0 ................................. SUCCESS [  1.734 s]
[INFO] Apache Atlas Test Utility Tools 2.1.0 .............. SUCCESS [  2.081 s]
[INFO] Apache Atlas Integration 2.1.0 ..................... SUCCESS [  3.208 s]
[INFO] Apache Atlas Common 2.1.0 .......................... SUCCESS [  1.013 s]
[INFO] Apache Atlas Client 2.1.0 .......................... SUCCESS [  0.079 s]
[INFO] atlas-client-common 2.1.0 .......................... SUCCESS [  0.391 s]
[INFO] atlas-client-v1 2.1.0 .............................. SUCCESS [  0.582 s]
[INFO] Apache Atlas Server API 2.1.0 ...................... SUCCESS [  0.819 s]
[INFO] Apache Atlas Notification 2.1.0 .................... SUCCESS [  1.437 s]
[INFO] atlas-client-v2 2.1.0 .............................. SUCCESS [  0.312 s]
[INFO] Apache Atlas Graph Database Projects 2.1.0 ......... SUCCESS [  0.036 s]
[INFO] Apache Atlas Graph Database API 2.1.0 .............. SUCCESS [  0.481 s]
[INFO] Graph Database Common Code 2.1.0 ................... SUCCESS [  0.443 s]
[INFO] Apache Atlas JanusGraph-HBase2 Module 2.1.0 ........ SUCCESS [  0.574 s]
[INFO] Apache Atlas JanusGraph DB Impl 2.1.0 .............. SUCCESS [  2.195 s]
[INFO] Apache Atlas Graph DB Dependencies 2.1.0 ........... SUCCESS [  0.749 s]
[INFO] Apache Atlas Authorization 2.1.0 ................... SUCCESS [  0.772 s]
[INFO] Apache Atlas Repository 2.1.0 ...................... SUCCESS [  4.489 s]
[INFO] Apache Atlas UI 2.1.0 .............................. SUCCESS [ 35.856 s]
[INFO] Apache Atlas New UI 2.1.0 .......................... SUCCESS [ 22.718 s]
[INFO] Apache Atlas Web Application 2.1.0 ................. SUCCESS [ 36.700 s]
[INFO] Apache Atlas Documentation 2.1.0 ................... SUCCESS [  0.569 s]
[INFO] Apache Atlas FileSystem Model 2.1.0 ................ SUCCESS [  0.709 s]
[INFO] Apache Atlas Plugin Classloader 2.1.0 .............. SUCCESS [  0.455 s]
[INFO] Apache Atlas Hive Bridge Shim 2.1.0 ................ SUCCESS [  0.919 s]
[INFO] Apache Atlas Hive Bridge 2.1.0 ..................... SUCCESS [  2.675 s]
[INFO] Apache Atlas Falcon Bridge Shim 2.1.0 .............. SUCCESS [  0.396 s]
[INFO] Apache Atlas Falcon Bridge 2.1.0 ................... SUCCESS [  0.789 s]
[INFO] Apache Atlas Sqoop Bridge Shim 2.1.0 ............... SUCCESS [  0.054 s]
[INFO] Apache Atlas Sqoop Bridge 2.1.0 .................... SUCCESS [  2.056 s]
[INFO] Apache Atlas Storm Bridge Shim 2.1.0 ............... SUCCESS [  0.160 s]
[INFO] Apache Atlas Storm Bridge 2.1.0 .................... SUCCESS [  1.137 s]
[INFO] Apache Atlas Hbase Bridge Shim 2.1.0 ............... SUCCESS [  0.586 s]
[INFO] Apache Atlas Hbase Bridge 2.1.0 .................... SUCCESS [  1.855 s]
[INFO] Apache HBase - Testing Util 2.1.0 .................. SUCCESS [  1.284 s]
[INFO] Apache Atlas Kafka Bridge 2.1.0 .................... SUCCESS [  0.795 s]
[INFO] Apache Atlas classification updater 2.1.0 .......... SUCCESS [  0.330 s]
[INFO] Apache Atlas Impala Hook API 2.1.0 ................. SUCCESS [  0.045 s]
[INFO] Apache Atlas Impala Bridge Shim 2.1.0 .............. SUCCESS [  0.049 s]
[INFO] Apache Atlas Impala Bridge 2.1.0 ................... SUCCESS [  1.668 s]
[INFO] Apache Atlas Distribution 2.1.0 .................... SUCCESS [01:42 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  03:56 min
[INFO] Finished at: 2021-07-23T10:49:28+08:00
[INFO] ------------------------------------------------------------------------

打包结果

打包成功后会生成如下文件

root@company:/opt/soft/apache-atlas-sources-2.1.0/distro/target# pwd
/opt/soft/apache-atlas-sources-2.1.0/distro/target
root@company:/opt/soft/apache-atlas-sources-2.1.0/distro/target# ll
total 2080588
drwxr-xr-x 24 root root       4