hbase（一）-集群模式搭建

1.简介

本文是hbase入门安装，装起后可以慢慢熟悉hbase相关功能。

2.实验环境

机器	hdfs	hbase
192.168.1.28(node28)	namenode,secondarynode	hmaster
192.168.2.11(node11)	datanode	regionserver
192.168.2.12(node12)	datanode	regionserver
192.168.2.19(node19)	datanode	regionserver

3.配置安装zookeeper

#解压tar文件
tar xzvf zookeeper-xxx.tar.gz -C /opt
ln -s /opt/zookeeper-xxx /opt/zookeeper

##
##配置zoo.cfg
##
vi /opt/zookeeper/conf/zoo.cfg
##修改配置文件
tickTime=2000
initLimit=10 
syncLimit=5
dataDir=/opt/zookeeper/data
clientPort=2181
server.1=192.168.1.28:2888:3888
server.2=192.168.2.11:2888:3888
server.3=192.168.2.12:2888:3888
server.4=192.168.2.19:2888:3888

##
##修改zookeeper客户端id
##
##注意：一定要在上面设置的data文件目录下面
vi /opt/zookeeper/data/myid
#写入1，保存

##拷贝到其它几个节点上
scp -r /opt/zookeeper node11:/opt
scp -r /opt/zookeeper node12:/opt
scp -r /opt/zookeeper node19:/opt
##按照配置文件中的序号，分别修改各客户端里面的myid

4.安装ntp

如果hbase的节点时间不同步会出现各种各样奇怪的问题，最直接的问题是有时连hbase的regionserver都启动不了，所以时间同步对hbase的regionserver节点来讲非常重要，必要安装组件。

安装,每台节点都要安装和配置

yum install ntp -y

配置

vim /etc/ntp.conf

##修改下面配置

# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
#所有节点可以指定到主节
server 192.168.1.28 iburst 
#或者指定到公网的ntp服务器，下面是阿里云的ntp服务器
server ntp1.aliyun.com iburst

#server 0.centos.pool.ntp.org iburst
#server 1.centos.pool.ntp.org iburst
#server 2.centos.pool.ntp.org iburst
#server 3.centos.pool.ntp.org iburst

#broadcast 192.168.1.255 autokey        # broadcast server
#broadcastclient                        # broadcast client
#broadcast 224.0.1.1 autokey            # multicast server
#multicastclient 224.0.1.1              # multicast client
#manycastserver 239.255.254.254         # manycast server
#manycastclient 239.255.254.254 autokey # manycast client

保存退出

##开启服务
systemctl start ntpd.service
##设置开机启动
systemctl enable ntpd.service

查看ntp服务状态

[root@ht06 ~]# service ntpd status
Redirecting to /bin/systemctl status  ntpd.service
● ntpd.service - Network Time Service
   Loaded: loaded (/usr/lib/systemd/system/ntpd.service; disabled; vendor preset: disabled)
   Active: active (running) since Mon 2018-03-05 14:13:44 CST; 2s ago
  Process: 6257 ExecStart=/usr/sbin/ntpd -u ntp:ntp $OPTIONS (code=exited, status=0/SUCCESS)
 Main PID: 6258 (ntpd)
   CGroup: /system.slice/ntpd.service
           └─6258 /usr/sbin/ntpd -u ntp:ntp -g

Mar 05 14:13:44 ht06 ntpd[6258]: ntp_io: estimated max descriptors: 1024, initial socket boundary: 16
Mar 05 14:13:44 ht06 ntpd[6258]: Listen and drop on 0 v4wildcard 0.0.0.0 UDP 123
Mar 05 14:13:44 ht06 ntpd[6258]: Listen and drop on 1 v6wildcard :: UDP 123
Mar 05 14:13:44 ht06 ntpd[6258]: Listen normally on 2 lo 127.0.0.1 UDP 123
Mar 05 14:13:44 ht06 ntpd[6258]: Listen normally on 3 enp1s0f0 192.168.2.6 UDP 123

5.hadoop安装(略)

6.配置安装hbase

• 解压tar文件

#主节点上执行
tar xzvf hbase-xxx.tar.gz -C /opt
ln -s /opt/hbase-xx /opt/hbase

• 配置hbase-env.sh

vi /opt/hbase/conf/hbase-env.sh
##修改hbase-env.sh
export JAVA_HOME=/opt/java/jdk
#不用hbase自带的zookeeper
export HBASE_MANAGES_ZK=false 

• 配置hbase-site.xml

    hbase.rootdir
    hdfs://node28:9000/hbase
  
  
    hbase.cluster.distributed
    true
  
  
    hbase.zookeeper.quorum
    node28,node11,node12,node19
  
  
    hbase.zookeeper.property.dataDir
    /opt/zookeeper/data
  

• 配置regionservers

##修改regionservers
node11
node12
node19  

7.启动

#每个节点上分别启动zookeeper
/opt/zookeeper/bin/zkServer.sh start
#主节点上启动hadoop
/opt/hadoop/sbin/start-all.sh
#主节点启动hbase
/opt/hbase/bin/start-hbase.sh

8.启动完成，查看UI页面

http://node28:16010

9.启动master高可以用(HA)

可以在另外一台机器上启动一个新的hmaster，来达到hmaster高可以用的作用。

/opt/hbase/bin/hbase-daemon.sh start master