Apache Atlas 2.1.0编译打包安装记录
目录
- 一、Apache Atlas简介
- 二、编译打包
-
- 1 打开官网下载源码
- 2 解压
- 3 打包
-
- 3.1 打包前的准备
- 3.2 执行打包命令
- 3.3 打包报错
- 打包结果
- 三、安装
-
- 1 移动到安装目录
- 2 启动服务
- 3 启动成功，但没有进程
- 4 单独启动
-
- 4.1 启动Hbase
- 4.2 启动Solr
- 4.3 启动Atlas
-
- 4.3.1 启动Atlas后台报错
- 4.3.2 解决后台报错
- 四、官方案例
-
- 1 运行导入脚本
- 2 查看样例数据
- 3 UI功能介绍
-
- 3.1 SEARCH(搜索)
- 3.2 CLASSIFICITION（分类）
- GLOSSARY术语表
- 吐槽
- 参考资料
一、Apache Atlas简介
Atlas 是一个可伸缩和可扩展的核心基础数据治理服务集合 ，使企业能够有效地和高效地满足 Hadoop 中的合规性要求，并允许与整个企业数据生态系统的集成。
项目地址：
https://github.com/apache/atlas
详细介绍:
https://blog.csdn.net/qq_38247150/article/details/108756790
二、编译打包
版本
Apache Atlas 2.1.0
Apache Maven 3.6.3
JDK 1.8
Python 2.7.18
Ubuntu 20.04.2 LTS
注意：
不建议使用win10打包！！！
语言方面jdk必须是1.8！！！
python必须是2.7！！！
笔者使用的是win10的WSL2打包的
Apache Atlas不提供安装包，需要自己下载源码打包。
1 打开官网下载源码
官网地址：
https://atlas.apache.org/2.1.0/index#/Downloads
笔者这里下载2.1.0的source
wget https://www.apache.org/dyn/closer.cgi/atlas/2.1.0/apache-atlas-2.1.0-sources.tar.gz
2 解压
tar -zxvf apache-atlas-2.1.0-sources.tar.gz
3 打包
3.1 打包前的准备
# 进入打包后的目录
cd apache-atlas-sources-2.1.0
# 设置maven打包进程的jvm参数。（-Xms表示初始化JAVA堆的大小及该进程刚创建出来的时候，他的专属JAVA堆的大小，一旦对象容量超过了JAVA堆的初始容量，JAVA堆将会自动扩容到-Xmx大小）
export MAVEN_OPTS="-Xms3g -Xmx3g"
3.2 执行打包命令
如果环境中已经有装好Apache Hbase和Apache Solr，执行这条
mvn clean -DskipTests package -Pdist
如果环境中没有Hbase和Solr，希望使用Atlas内置的Hbase和Solr，执行这条；
笔者这里没有hadoop环境，只好使用这条命令了。
mvn clean -DskipTests package -Pdist,embedded-hbase-solr
如果希望使用Atlas内置的Apache Cassandra 和 Apache Solr，执行这条命令
mvn clean package -Pdist,embedded-cassandra-solr
打包过程要下很多jar包和node安装包，速度快慢看网络速度，网络慢或者有波动的话下载会中断，需要要多重试几次。
打包过程中会下载node安装包，如果有代理可以手动提前下载好放到指定目录，这样会快不少。
[INFO] Installing node version v12.16.0
[INFO] Downloading https://nodejs.org/dist/v12.16.0/node-v12.16.0-linux-x64.tar.gz to /root/.m2/repository/com/github/eirslett/node/12.16.0/node-12.16.0-linux-x64.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
3.3 打包报错
Too many files with unapproved license
[ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.13:check (rat-check) on project apache-atlas: Too many files with unapproved license: 1274 See RAT report in: /opt/soft/apache-atlas-sources-2.1.0/target/rat.txt -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :apache-atlas
检查license报错，添加参数-Drat.skip=true跳过license检查。再次执行命令
# 修改前命令
mvn clean -DskipTests package -Pdist,embedded-hbase-solr
# 修改后命令
mvn clean -DskipTests package -Pdist,embedded-hbase-solr -Drat.skip=true
最后，终于打包成功了
[INFO] Apache Atlas Server Build Tools 1.0 ................ SUCCESS [ 0.511 s]
[INFO] apache-atlas 2.1.0 ................................. SUCCESS [ 1.734 s]
[INFO] Apache Atlas Test Utility Tools 2.1.0 .............. SUCCESS [ 2.081 s]
[INFO] Apache Atlas Integration 2.1.0 ..................... SUCCESS [ 3.208 s]
[INFO] Apache Atlas Common 2.1.0 .......................... SUCCESS [ 1.013 s]
[INFO] Apache Atlas Client 2.1.0 .......................... SUCCESS [ 0.079 s]
[INFO] atlas-client-common 2.1.0 .......................... SUCCESS [ 0.391 s]
[INFO] atlas-client-v1 2.1.0 .............................. SUCCESS [ 0.582 s]
[INFO] Apache Atlas Server API 2.1.0 ...................... SUCCESS [ 0.819 s]
[INFO] Apache Atlas Notification 2.1.0 .................... SUCCESS [ 1.437 s]
[INFO] atlas-client-v2 2.1.0 .............................. SUCCESS [ 0.312 s]
[INFO] Apache Atlas Graph Database Projects 2.1.0 ......... SUCCESS [ 0.036 s]
[INFO] Apache Atlas Graph Database API 2.1.0 .............. SUCCESS [ 0.481 s]
[INFO] Graph Database Common Code 2.1.0 ................... SUCCESS [ 0.443 s]
[INFO] Apache Atlas JanusGraph-HBase2 Module 2.1.0 ........ SUCCESS [ 0.574 s]
[INFO] Apache Atlas JanusGraph DB Impl 2.1.0 .............. SUCCESS [ 2.195 s]
[INFO] Apache Atlas Graph DB Dependencies 2.1.0 ........... SUCCESS [ 0.749 s]
[INFO] Apache Atlas Authorization 2.1.0 ................... SUCCESS [ 0.772 s]
[INFO] Apache Atlas Repository 2.1.0 ...................... SUCCESS [ 4.489 s]
[INFO] Apache Atlas UI 2.1.0 .............................. SUCCESS [ 35.856 s]
[INFO] Apache Atlas New UI 2.1.0 .......................... SUCCESS [ 22.718 s]
[INFO] Apache Atlas Web Application 2.1.0 ................. SUCCESS [ 36.700 s]
[INFO] Apache Atlas Documentation 2.1.0 ................... SUCCESS [ 0.569 s]
[INFO] Apache Atlas FileSystem Model 2.1.0 ................ SUCCESS [ 0.709 s]
[INFO] Apache Atlas Plugin Classloader 2.1.0 .............. SUCCESS [ 0.455 s]
[INFO] Apache Atlas Hive Bridge Shim 2.1.0 ................ SUCCESS [ 0.919 s]
[INFO] Apache Atlas Hive Bridge 2.1.0 ..................... SUCCESS [ 2.675 s]
[INFO] Apache Atlas Falcon Bridge Shim 2.1.0 .............. SUCCESS [ 0.396 s]
[INFO] Apache Atlas Falcon Bridge 2.1.0 ................... SUCCESS [ 0.789 s]
[INFO] Apache Atlas Sqoop Bridge Shim 2.1.0 ............... SUCCESS [ 0.054 s]
[INFO] Apache Atlas Sqoop Bridge 2.1.0 .................... SUCCESS [ 2.056 s]
[INFO] Apache Atlas Storm Bridge Shim 2.1.0 ............... SUCCESS [ 0.160 s]
[INFO] Apache Atlas Storm Bridge 2.1.0 .................... SUCCESS [ 1.137 s]
[INFO] Apache Atlas Hbase Bridge Shim 2.1.0 ............... SUCCESS [ 0.586 s]
[INFO] Apache Atlas Hbase Bridge 2.1.0 .................... SUCCESS [ 1.855 s]
[INFO] Apache HBase - Testing Util 2.1.0 .................. SUCCESS [ 1.284 s]
[INFO] Apache Atlas Kafka Bridge 2.1.0 .................... SUCCESS [ 0.795 s]
[INFO] Apache Atlas classification updater 2.1.0 .......... SUCCESS [ 0.330 s]
[INFO] Apache Atlas Impala Hook API 2.1.0 ................. SUCCESS [ 0.045 s]
[INFO] Apache Atlas Impala Bridge Shim 2.1.0 .............. SUCCESS [ 0.049 s]
[INFO] Apache Atlas Impala Bridge 2.1.0 ................... SUCCESS [ 1.668 s]
[INFO] Apache Atlas Distribution 2.1.0 .................... SUCCESS [01:42 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:56 min
[INFO] Finished at: 2021-07-23T10:49:28+08:00
[INFO] ------------------------------------------------------------------------
打包结果
打包成功后会生成如下文件
root@company:/opt/soft/apache-atlas-sources-2.1.0/distro/target# pwd
/opt/soft/apache-atlas-sources-2.1.0/distro/target
root@company:/opt/soft/apache-atlas-sources-2.1.0/distro/target# ll
total 2080588
drwxr-xr-x 24 root root 4