impala-3.2.0安装教程(centos7无需安装CDH)

目录

  • 导语:
  • 安装前需下载
  • 开始安装
    • 第一步:安装已下载的安装包
    • 第二步:配置bigtop-utils
    • 第三步:配置impala的conf
    • 第四步:配置impala所需mysql的语言包
    • 第五步:配置impala
    • 第五步:启动impala
    • 第六步:测试impala
  • 安装中遇到的问题
    • 报错1:由于python3的启动问题
    • 报错2:缺少系统依赖,造成原因可能为下载错误文件
    • 报错3:缺少系统相关依赖
    • 报错4:缺少gcc
    • 报错5:下载不同版本导致的不同依赖冲突
    • 报错6:hive暂不支持3版本以上的依赖包
  • 卸载命令
  • 修改impala依赖(不想下载cdh的依赖包)

导语:

已安装hadoop3.1.2,spark2.4.3,hbase2.1.5,hive3.1.1,zookeeper3.4.14,jdk1.8.0_211,mysql5.6.45,sentry-2.1.0,(未搭建,仅下载官方tar提供impala依赖)为了新增交互式查询功能,选择Cloudera impala提供技术,当前cdh最新版本为6.3.0,其更新的版本较慢,如安装cdh则会降低版本,这是我们所不希望的,因此本文基于这样的场景下教程如何在不安装cdh的情况下安装impala3.2.0。本机使用的权限为root。注(最终hive3的部分格式不支持如’org.apache.hive.hcatalog.data.JsonSerDe’,hive2的数据格式可以正常使用)
附:CDH6.3对应组件版本:
https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_63_packaging.html#cdh_630_packaging
apache impala提供的tar下载版本其原理是一键安装,然后会在本地重新下载cdh的对应版本,但是其使用的方法并不符合我们的需求,因此我们选择使用cloudera官方提供的RPM包进行下载,下载其程序是为了获取依赖包。不影响我们使用的集群。

安装前需下载

我下载的是centos7,其他系统注意修改下载地址
下载链接:https://archive.cloudera.com/cdh6/6.3.0/redhat7/yum/RPMS/x86_64/
hadoop-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:04 102.00MB
hadoop-client-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:01 25.00KB
hadoop-conf-pseudo-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:04 9.00KB
hadoop-debuginfo-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:04 1.00MB
hadoop-doc-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:02 6.00MB
hadoop-hdfs-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 44.00MB
hadoop-hdfs-datanode-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 5.00KB
hadoop-hdfs-fuse-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 23.00KB
hadoop-hdfs-journalnode-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:04 5.00KB
hadoop-hdfs-namenode-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:02 6.00KB
hadoop-hdfs-nfs3-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 5.00KB
hadoop-hdfs-secondarynamenode-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:01 5.00KB
hadoop-hdfs-zkfc-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:01 6.00KB
hadoop-httpfs-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:02 9.00KB
hadoop-kms-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:01 8.00KB
hadoop-kms-server-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 5.00KB
hadoop-libhdfs-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 29.00KB
hadoop-libhdfs-devel-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 11.00KB
hadoop-mapreduce-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 20.00MB
hadoop-mapreduce-historyserver-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:01 5.00KB
hadoop-yarn-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:02 17.00MB
hadoop-yarn-nodemanager-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 5.00KB
hadoop-yarn-proxyserver-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 5.00KB
hadoop-yarn-resourcemanager-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:04 5.00KB
hadoop-yarn-timelinereader-3.0.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:01 5.00KB
impala-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:01 221.00MB
impala-catalog-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 5.00KB
impala-debuginfo-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:01 235.00MB
impala-server-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:04 5.00KB
impala-shell-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:03 968.00KB
impala-state-store-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:02 5.00KB
impala-udf-devel-3.2.0+cdh6.3.0-1279813.el7.x86_64.rpm 2019-07-31 16:02 65.00KB

下载地址:[https://archive.cloudera.com/cdh6/6.3.0/redhat7/yum/RPMS/noarch/]已失效(https://archive.cloudera.com/cdh6/6.3.0/redhat7/yum/RPMS/noarch/)
https://archive.cloudera.com/cdh6/6.3.2/redhat7/yum/RPMS/noarch/已订正
网站会出现维护,如出现失效,可尝试访问https://archive.cloudera.com/cdh6/更换

bigtop-utils-0.7.0+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:02 11.00KB
hive-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:03 182.00MB
hive-hbase-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:01 3.00KB
hive-hcatalog-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:03 478.00KB
hive-jdbc-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:02 41.00MB
hive-metastore-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:02 5.00KB
hive-server-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:02 5.00KB
hive-server2-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:01 5.00KB
hive-webhcat-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:03 2.00MB
hive-webhcat-server-2.1.1+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:02 5.00KB
sentry-2.1.0+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:01 100.00MB
sentry-hdfs-plugin-2.1.0+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:01 1.00MB
sentry-store-2.1.0+cdh6.3.0-1279813.el7.noarch.rpm 2019-07-31 16:03 5.00KB
以上为了提供impala完整依赖,集群还是使用apache版,经测试,apache的hadoop3.1.2和3.0.0依赖包都会导致impala错误,因此下载cdh的hadoop3.0.0来获取依赖

开始安装

第一步:安装已下载的安装包

rpm -ivh --nodeps impala*
rpm -ivh --nodeps hadoop*
rpm -ivh --nodeps bigtop-utils-0.7.0+cdh6.3.0-1279813.noarch.rpm
rpm -ivh --nodeps hive*
rpm -ivh --nodeps sentry*

将下载的全部rpm进行安装,impala的依赖文件夹为:/usr/lib/impala/lib/,如果全部下载则会有所需依赖链接。否则需要自行寻找本机中的依赖包,可查看文末impala依赖修改

第二步:配置bigtop-utils

vim /etc/default/bigtop-utils 修改java路径
export JAVA_HOME=/home/jdk1.8.0_211 #这里改到自己的java路径

第三步:配置impala的conf


cp $HADOOP_HOME/etc/hadoop/hdfs-site.xml /etc/impala/conf
cp $HADOOP_HOME/etc/hadoop/core-site.xml /etc/impala/conf
cp $HIVE_HOME/conf/hive-site.xml /etc/impala/conf
vim /etc/impala/conf/hive-site.xml
  <!-- 指定hive metastore服务请求的uri地址 -->  
  <property> 
    <name>hive.metastore.uris</name>  
    <value>thrift://zx1:9083</value>  #这里是自己的主机名
  </property> 

vim /etc/impala/conf/hdfs-site.xml

<property>
		<name>dfs.client.read.shortcircuit</name>
		<value>true</value>
	</property>
	<property>
		<name>dfs.domain.socket.path</name>
		<value>/var/run/hdfs-sockets/dn</value>
	</property>
	<property>
		<name>dfs.client.file-block-storage-locations.timeout.millis</name>
		<value>10000</value>
	</property>
	<property>
		<name>dfs.datanode.hdfs-blocks-metadata.enabled</name>
		<value>true</value>
	</property> 
#创建上面路径
mkdir /var/run/hdfs-sockets/
最后将上面修改的文件cp所有主机,集群内的配置文件也要修改

第四步:配置impala所需mysql的语言包

find / -name mysql-connector-*.jar #查找本机mysql-connector.jar路径
ln -s /home/hive-3.1.1/lib/mysql-connector-java-5.1.47-bin.jar /home/jdk1.8.0_211/mysql-connector-java.jar #软连接到java路径下

第五步:配置impala

vim /etc/default/impala
IMPALA_CATALOG_SERVICE_HOST=zx3 #修改为自己的主机名
IMPALA_STATE_STORE_HOST=zx3
MYSQL_CONNECTOR_JAR=/home/jdk1.8.0_211/mysql-connector-java.jar

impala-3.2.0安装教程(centos7无需安装CDH)_第1张图片

第五步:启动impala

hive --service metastore &
service impala-state-store start
service impala-catalog start
service impala-server start
ps -ef | grep impala
jps

impala-3.2.0安装教程(centos7无需安装CDH)_第2张图片
以上如果报错则查看impala错误日志路径cd /var/log/impala/
catalogd.ERROR,impalad.ERROR,statestored.ERROR
大部分原因为依赖错误,可查看文末的impala依赖修改问题

第六步:测试impala

测试impala

impala-shell
show databases;
use zx1;
desc t1; #查询其中的表结构,如果无误则安装成功

安装中遇到的问题

报错1:由于python3的启动问题

[root@8e6ba95470a5 hdfs-sockets]# impala-shell
  File "/usr/lib/impala-shell/impala_shell.py", line 262
    print "Query options (defaults shown in []):"

解决思路:

vim /usr/bin/impala-shell

在这里插入图片描述

报错2:缺少系统依赖,造成原因可能为下载错误文件

/usr/lib/impala/sbin/catalogd: error while loading shared libraries: libcrypto.so.1.0.0: cannot open shared object file: No such file or directory
/usr/lib/impala/sbin/catalogd: error while loading shared libraries: libssl.so.1.0.0: cannot open shared object file: No such file or directory

解决思路:
找到本机存在的版本进行软连接即可

报错3:缺少系统相关依赖

/usr/lib/impala/sbin/catalogd: /lib64/libc.so.6: version `GLIBC_2.18' not found (required by /usr/lib/impala/lib/libstdc++.so.6)

解决思路:https://blog.csdn.net/wiborgite/article/details/87707938

curl -O http://ftp.gnu.org/gnu/glibc/glibc-2.18.tar.gz
tar zxf glibc-2.18.tar.gz 
cd glibc-2.18/
mkdir build
cd build/
../configure --prefix=/usr
make -j2   #时间较长
make install

报错4:缺少gcc

在解决问题3的过程中发现缺少gcc

[root@8e6ba95470a5 build]# ../configure --prefix=/usr
checking build system type... x86_64-unknown-linux-gnu
checking host system type... x86_64-unknown-linux-gnu
checking for gcc... no
checking for cc... no
checking for cl.exe... no
configure: error: in `/home/glibc-2.18/build/glibc-2.18/build':
configure: error: no acceptable C compiler found in $PATH
See `config.log' for more details

解决思路:

yum -y install gcc

报错5:下载不同版本导致的不同依赖冲突

版本冲突问题

log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
log4j:ERROR Could not instantiate class [org.apache.solr.sentry.RollingFileWithoutDeleteAppender].
log4j:ERROR Could not instantiate appender named "solrAudit".

impala-3.2.0安装教程(centos7无需安装CDH)_第3张图片
解决思路:
本机存在旧的版本依赖,卸载重装前删除文件夹,卸载重新安装rpm
rm -rf /usr/lib/impala

报错6:hive暂不支持3版本以上的依赖包

修改impala依赖包为cdh2.1.1版本
/usr/lib/impala/lib/hive-exec.jar

java.lang.NoSuchMethodError: getJvmMetrics
F0822 06:26:35.714833 25551 init.cc:242] Failed to find JniUtil.getJvmMetrics method.
. Impalad exiting.
*** Check failure stack trace: ***
    @          0x20a2ccd  google::LogMessage::Fail()
    @          0x20a4572  google::LogMessage::SendToLog()
    @          0x20a26a7  google::LogMessage::Flush()
    @          0x20a5c6e  google::LogMessageFatal::~LogMessageFatal()
    @           0x954d06  impala::InitCommonRuntime()
    @           0x929721  CatalogdMain()
    @           0x8e1b46  main
    @     0x7fa370126a85  __libc_start_main
    @           0x928f41  (unknown)

卸载命令

由于安装并不完全,因此卸载可能会发生问题
impala无法卸载rpm的解决命令

rpm -qa|grep impala|xargs rpm -e --noscripts

修改impala依赖(不想下载cdh的依赖包)

这里提供我写的依赖路径脚本(hadoop3会报错,必须使用cdh版的hadoop3依赖)
先查看impala的软连接
ll /usr/lib/impala/lib/
可看到很多错误的软连接
首先删除软连接:

#!bin/bash
rm -rf /usr/lib/impala/lib/kudu*.jar
rm -rf /usr/lib/impala/lib/avro*.jar
#rm -rf /usr/lib/impala/lib/hadoop-*.jar
#rm -rf /usr/lib/impala/lib/hive-*.jar
rm -rf /usr/lib/impala/lib/hbase-*.jar
rm -rf /usr/lib/impala/lib/parquet-hadoop-bundle.jar
#rm -rf /usr/lib/impala/lib/sentry-*.jar
rm -rf /usr/lib/impala/lib/zookeeper.jar
rm -rf /usr/lib/impala/lib/libhadoop.so
rm -rf /usr/lib/impala/lib/libhadoop.so.1.0.0
rm -rf /usr/lib/impala/lib/libhdfs.so
rm -rf /usr/lib/impala/lib/libhdfs.so.0.0.0

建立软连接

#!bin/bash
HBASE_HOME=/home/hbase-2.1.5
HADOOP_HOME=/home/hadoop-3.0.0
HIVE_HOME=/home/hive-3.1.1
#HIVE_HOME=/usr/lib/hive
ZK_HOME=/home/zookeeper-3.4.14
SENTRY_HOME=/home/sentry-2.1.0
ln -s /home/impala/kudu-client-1.9.0.jar /usr/lib/impala/lib/kudu-client.jar
ln -s $HBASE_HOME/lib/avro-1.7.7.jar /usr/lib/impala/lib/avro.jar
ln -s $HADOOP_HOME/share/hadoop/common/lib/hadoop-annotations-3.0.0.jar /usr/lib/impala/lib/hadoop-annotations.jar
ln -s $HADOOP_HOME/share/hadoop/common/lib/hadoop-auth-3.0.0.jar /usr/lib/impala/lib/hadoop-auth.jar
####ln -s $HADOOP_HOME/share/hadoop/tools/lib/hadoop-archives-3.0.0.jar /usr/lib/impala/lib/hadoop-archives.jar
ln -s $HADOOP_HOME/share/hadoop/tools/lib/hadoop-aws-3.0.0.jar /usr/lib/impala/lib/hadoop-aws.jar
ln -s $HADOOP_HOME/share/hadoop/tools/lib/hadoop-azure-datalake-3.0.0.jar /usr/lib/impala/lib/hadoop-azure-datalake.jar
ln -s $HADOOP_HOME/share/hadoop/tools/lib/hadoop-azure-3.0.0.jar /usr/lib/impala/lib/hadoop-azure.jar
ln -s $HADOOP_HOME/share/hadoop/common/hadoop-common-3.0.0.jar /usr/lib/impala/lib/hadoop-common.jar
ln -s $HADOOP_HOME/share/hadoop/tools/lib/hadoop-distcp-3.0.0.jar /usr/lib/impala/lib/hadoop-distcp.jar
ln -s $HADOOP_HOME/share/hadoop/hdfs/hadoop-hdfs-client-3.0.0.jar /usr/lib/impala/lib/hadoop-hdfs-client.jar
ln -s $HADOOP_HOME/share/hadoop/hdfs/hadoop-hdfs-3.0.0.jar /usr/lib/impala/lib/hadoop-hdfs.jar
ln -s $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.0.0.jar /usr/lib/impala/lib/hadoop-mapreduce-client-common.jar
ln -s $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.0.0.jar /usr/lib/impala/lib/hadoop-mapreduce-client-core.jar
ln -s $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.0.0.jar /usr/lib/impala/lib/hadoop-mapreduce-client-jobclient.jar
####ln -s $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.0.0.jar /usr/lib/impala/lib/hadoop-mapreduce-client-shuffle.jar
ln -s $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-api-3.0.0.jar /usr/lib/impala/lib/hadoop-yarn-api.jar
ln -s $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-client-3.0.0.jar /usr/lib/impala/lib/hadoop-yarn-client.jar
ln -s $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-common-3.0.0.jar /usr/lib/impala/lib/hadoop-yarn-common.jar
ln -s $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.0.0.jar /usr/lib/impala/lib/hadoop-yarn-server-applicationhistoryservice.jar
ln -s $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-common-3.0.0.jar /usr/lib/impala/lib/hadoop-yarn-server-common.jar
####ln -s $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.0.0.jar /usr/lib/impala/lib/hadoop-yarn-server-nodemanager.jar
ln -s $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.0.0.jar /usr/lib/impala/lib/hadoop-yarn-server-resourcemanager.jar
ln -s $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.0.0.jar /usr/lib/impala/lib/hadoop-yarn-server-web-proxy.jar
####ln -s $HBASE_HOME/lib/hbase-annotations-2.1.5.jar /usr/lib/impala/lib/hbase-annotations.jar
ln -s $HBASE_HOME/lib/hbase-client-2.1.5.jar /usr/lib/impala/lib/hbase-client.jar
ln -s $HBASE_HOME/lib/hbase-common-2.1.5.jar /usr/lib/impala/lib/hbase-common.jar
ln -s $HBASE_HOME/lib/hbase-hadoop2-compat-2.1.5.jar /usr/lib/impala/lib/hbase-hadoop2-compat.jar
ln -s $HBASE_HOME/lib/hbase-hadoop2-compat-2.1.5-tests.jar /usr/lib/impala/lib/hbase-hadoop2-compat-tests.jar
ln -s $HBASE_HOME/lib/hbase-hadoop-compat-2.1.5.jar /usr/lib/impala/lib/hbase-hadoop-compat.jar
ln -s $HBASE_HOME/lib/hbase-http-2.1.5.jar /usr/lib/impala/lib/hbase-http.jar
ln -s $HBASE_HOME/lib/hbase-mapreduce-2.1.5.jar /usr/lib/impala/lib/hbase-mapreduce.jar
ln -s $HBASE_HOME/lib/hbase-metrics-api-2.1.5.jar /usr/lib/impala/lib/hbase-metrics-api.jar
ln -s $HBASE_HOME/lib/hbase-metrics-2.1.5.jar /usr/lib/impala/lib/hbase-metrics.jar
ln -s $HBASE_HOME/lib/hbase-procedure-2.1.5.jar /usr/lib/impala/lib/hbase-procedure.jar
ln -s $HBASE_HOME/lib/hbase-protocol-shaded-2.1.5.jar /usr/lib/impala/lib/hbase-protocol-shaded.jar
ln -s $HBASE_HOME/lib/hbase-protocol-2.1.5.jar /usr/lib/impala/lib/hbase-protocol.jar
ln -s $HBASE_HOME/lib/hbase-replication-2.1.5.jar /usr/lib/impala/lib/hbase-replication.jar
ln -s $HBASE_HOME/lib/hbase-server-2.1.5.jar /usr/lib/impala/lib/hbase-server.jar
ln -s $HBASE_HOME/lib/hbase-shaded-miscellaneous-2.1.0.jar /usr/lib/impala/lib/hbase-shaded-miscellaneous.jar
ln -s $HBASE_HOME/lib/hbase-shaded-netty-2.1.0.jar /usr/lib/impala/lib/hbase-shaded-netty.jar
ln -s $HBASE_HOME/lib/hbase-shaded-protobuf-2.1.0.jar /usr/lib/impala/lib/hbase-shaded-protobuf.jar
ln -s $HBASE_HOME/lib/hbase-zookeeper-2.1.5.jar /usr/lib/impala/lib/hbase-zookeeper.jar
ln -s /usr/lib/hive/lib/hive-ant.jar /usr/lib/impala/lib/hive-ant.jar
ln -s $HIVE_HOME/lib/hive-beeline-3.1.1.jar /usr/lib/impala/lib/hive-beeline.jar
ln -s $HIVE_HOME/lib/hive-cli-3.1.1.jar /usr/lib/impala/lib/hive-cli.jar
ln -s $HIVE_HOME/lib/hive-classification-3.1.1.jar /usr/lib/impala/lib/hive-classification.jar
ln -s $HIVE_HOME/lib/hive-common-3.1.1.jar /usr/lib/impala/lib/hive-common.jar
ln -s /usr/lib/hive/lib/hive-exec.jar /usr/lib/impala/lib/hive-exec.jar
ln -s $HIVE_HOME/lib/hive-hbase-handler-3.1.1.jar /usr/lib/impala/lib/hive-hbase-handler.jar
ln -s $HIVE_HOME/lib/hive-hcatalog-server-extensions-3.1.1.jar /usr/lib/impala/lib/hive-hcatalog-server-extensions.jar
ln -s $HIVE_HOME/lib/hive-hcatalog-core-3.1.1.jar /usr/lib/impala/lib/hive-hcatalog-core.jar
ln -s $HIVE_HOME/lib/hive-llap-client-3.1.1.jar /usr/lib/impala/lib/hive-llap-client.jar
ln -s $HIVE_HOME/lib/hive-llap-tez-3.1.1.jar /usr/lib/impala/lib/hive-llap-tez.jar
ln -s $HIVE_HOME/lib/hive-llap-common-3.1.1.jar /usr/lib/impala/lib/hive-llap-common.jar
ln -s $HIVE_HOME/lib/hive-metastore-3.1.1.jar /usr/lib/impala/lib/hive-metastore.jar
ln -s /usr/lib/hive/lib/hive-orc.jar /usr/lib/impala/lib/hive-orc.jar
ln -s $HIVE_HOME/lib/hive-serde-3.1.1.jar /usr/lib/impala/lib/hive-serde.jar
ln -s $HIVE_HOME/lib/hive-service-3.1.1.jar /usr/lib/impala/lib/hive-service.jar
ln -s $HIVE_HOME/lib/hive-service-rpc-3.1.1.jar /usr/lib/impala/lib/hive-service-rpc.jar
ln -s $HIVE_HOME/lib/hive-shims-common-3.1.1.jar /usr/lib/impala/lib/hive-shims-common.jar
ln -s $HIVE_HOME/lib/hive-shims-3.1.1.jar /usr/lib/impala/lib/hive-shims.jar
ln -s $HIVE_HOME/lib/hive-shims-scheduler-3.1.1.jar /usr/lib/impala/lib/hive-shims-scheduler.jar
ln -s $HIVE_HOME/lib/hive-storage-api-2.7.0.jar /usr/lib/impala/lib/hive-storage-api.jar
ln -s $HADOOP_HOME/lib/native/libhadoop.so /usr/lib/impala/lib/libhadoop.so
ln -s $HADOOP_HOME/lib/native/libhadoop.so.1.0.0 /usr/lib/impala/lib/libhadoop.so.1.0.0
####ln -s $HADOOP_HOME/lib/native/libhdfs.so /usr/lib/impala/lib/libhdfs.so
####ln -s $HADOOP_HOME/lib/native/libhdfs.so.0.0.0 /usr/lib/impala/lib/libhdfs.so.0.0.0
ln -s /home/hive-3.1.1/lib/parquet-hadoop-bundle-1.10.0.jar /usr/lib/impala/lib/parquet-hadoop-bundle.jar
ln -s $SENTRY_HOME/lib/sentry-binding-hive-2.1.0.jar /usr/lib/impala/lib/sentry-binding-hive.jar
ln -s $SENTRY_HOME/lib/sentry-binding-hive-conf-2.1.0.jar /usr/lib/impala/lib/sentry-binding-hive-conf.jar
ln -s $SENTRY_HOME/lib/sentry-binding-hive-common-2.1.0.jar /usr/lib/impala/lib/sentry-binding-hive-common.jar
ln -s $SENTRY_HOME/lib/sentry-binding-hive-follower-2.1.0.jar /usr/lib/impala/lib/sentry-binding-hive-follower.jar
ln -s $SENTRY_HOME/lib/sentry-hdfs-common-2.1.0.jar /usr/lib/impala/lib/sentry-hdfs-common.jar
ln -s $SENTRY_HOME/lib/sentry-core-common-2.1.0.jar /usr/lib/impala/lib/sentry-core-common.jar
ln -s $SENTRY_HOME/lib/sentry-core-model-db-2.1.0.jar /usr/lib/impala/lib/sentry-core-model-db.jar
ln -s $SENTRY_HOME/lib/sentry-core-model-indexer-2.1.0.jar /usr/lib/impala/lib/sentry-core-model-indexer.jar
ln -s $SENTRY_HOME/lib/sentry-core-model-kafka-2.1.0.jar /usr/lib/impala/lib/sentry-core-model-kafka.jar
ln -s $SENTRY_HOME/lib/sentry-core-model-solr-2.1.0.jar /usr/lib/impala/lib/sentry-core-model-solr.jar
ln -s $SENTRY_HOME/lib/sentry-policy-common-2.1.0.jar /usr/lib/impala/lib/sentry-policy-common.jar
ln -s $SENTRY_HOME/lib/sentry-policy-engine-2.1.0.jar /usr/lib/impala/lib/sentry-policy-engine.jar
ln -s $SENTRY_HOME/lib/sentry-provider-cache-2.1.0.jar /usr/lib/impala/lib/sentry-provider-cache.jar
ln -s $SENTRY_HOME/lib/sentry-provider-common-2.1.0.jar /usr/lib/impala/lib/sentry-provider-common.jar
ln -s $SENTRY_HOME/lib/sentry-provider-db-2.1.0.jar /usr/lib/impala/lib/sentry-provider-db.jar
ln -s $SENTRY_HOME/lib/sentry-provider-file-2.1.0.jar /usr/lib/impala/lib/sentry-provider-file.jar
ln -s $SENTRY_HOME/lib/sentry-service-client-2.1.0.jar /usr/lib/impala/lib/sentry-service-client.jar
ln -s $SENTRY_HOME/lib/sentry-service-api-2.1.0.jar /usr/lib/impala/lib/sentry-service-api.jar
ln -s /usr/lib/sentry/lib/sentry-shaded-miscellaneous.jar /usr/lib/impala/lib/sentry-shaded-miscellaneous.jar
ln -s $ZK_HOME/zookeeper-3.4.14.jar /usr/lib/impala/lib/zookeeper.jar

你可能感兴趣的:(大数据)