hive3.1.2安装
- 下载hive
wget http://mirror.bit.edu.cn/apache/hive/hive-3.1.2/apache-hive-3.1.2-bin.tar.gz
- 安装
tar -zxvf apache-hive-3.1.2-bin.tar.gz -C /root/apps #解压
mv apache-hive-3.1.2-bin hive-3.1.2 #改名
- 配置环境
export HIVE_HOME=/root/apps/hive-3.1.2
export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$HIVE_HOME/bin
- 下载mysql-connector-java-5.1.39.jar 添加到/root/apps/hive-3.1.2/lib下
wget https://gitee.com/chenshiba/code/blob/master/mysql-connector-java-5.1.39.jar
- 修改hive-env.sh
mv hive-env.sh.template hive-env.sh
vim hive-env.sh
添加如下内容
HADOOP_HOME=/root/apps/hadoop-3.1.2
export HIVE_CONF_DIR=/root/apps/hive-3.1.2/conf
export HIVE_AUX_JARS_PATH=/root/apps/hive-3.1.2/lib
- 创建hive-site.xml
vim /root/apps/hive-3.1.2/conf/hive-site.xml
javax.jdo.option.ConnectionURL
jdbc:mysql://mini3:3306/hive?createDatabaseIfNotExist=true&useUnicode=true&characterEncoding=UTF-8&useSSL=false
javax.jdo.option.ConnectionDriverName
com.mysql.jdbc.Driver
javax.jdo.option.ConnectionUserName
root
javax.jdo.option.ConnectionPassword
1234
datanucleus.readOnlyDatastore
false
datanucleus.fixedDatastore
false
datanucleus.autoCreateSchema
true
datanucleus.schema.autoCreateAll
true
datanucleus.autoCreateTables
true
datanucleus.autoCreateColumns
true
hive.metastore.local
true
hive.cli.print.header
true
hive.cli.print.current.db
true
- 格式化数据库
schematool -dbType mysql -initSchema
- 连接客户端
方式一：
hive
方式二：
nohup hiveserver2 1>/dev/null 2>&1 &
beeline -u jdbc:hive2://localhost:10000 -n root
hive常见的问题
- 启动 hive 时
WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
解决办法
jdbc:mysql://mini3:3306/hive?characterEncoding=utf8&createDatabaseIfNotExist=true&useSSL=false
- 进入hive 执行show databases时报错
FAILED: HiveException java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
解决办法
schematool -dbType mysql -initSchema
- 格式化数据库错误
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
Underlying cause: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException : Communications link failure
The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
SQL Error code: 0
Use --verbose for detailed stacktrace.
*** schemaTool failed ***
解决办法
确认连接的数据库是否正确
- beeline 拒绝连接
Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000: Failed to open new session: java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: root is not allowed to impersonate root (state=08S01,code=0)
解决办法
通过httpfs协议访问rest接口，以root用户包装自己用户的方式操作HDFS
首先需要开启rest接口，在hdfs-site.xml文件中加入：
dfs.webhdfs.enabled
true
然后在core-site.xml文件中加入：
hadoop.proxyuser.root.hosts
*
hadoop.proxyuser.root.groups
*