Hbase 集群的安装部署

目录

1、下载HBase二进制源码包

2、配置环境变量

3、配置ZooKeeper和Hbase配置项

4、修改regionservers文件

5、修改冲突jar包

6、查看相关进程是否启动

7、访问hbase页面

部署集群：

192.168.20.11 node1
192.168.20.12 node2
192.168.20.13 node3

 

1、下载HBase二进制源码包

在node1，node2，node3上操作

[hadoop@node1 ~]$ cd /usr/local
[hadoop@node1 local]$ sudo wget https://archive.apache.org/dist/hbase/2.4.8/hbase-2.4.8-bin.tar.gz
[hadoop@node1 local]$ sudo tar -xvf hbase-2.4.8-bin.tar.gz
[hadoop@node1 local]$ sudo ln -s hbase-2.4.8 hbase
[hadoop@node1 local]$ sudo  chown -R  hadoop:hadoop hbase
[hadoop@node1 local]$ sudo  chown -R  hadoop:hadoop hbase-2.4.8

##################################################### 

2、配置环境变量

[hadoop@node1 conf]$ cd /usr/local/hbase/conf
[hadoop@node1 conf]$ vim conf/hbase-env.sh
export JAVA_HOME=/usr/local/jdk
export HBASE_HEAPSIZE=4G
export HBASE_MANAGES_ZK=false
export HBASE_PID_DIR=/data/hbase

#####################################################  

3、配置ZooKeeper和Hbase配置项

在node1，node2，node3上操作

[hadoop@node1 conf]$ cd /usr/local/hbase/conf
# 配置ZooKeeper和Hbase配置项
# 将 hbase-site.xml 中的内容替换为如下内容
[hadoop@node1 conf]$ vim hbase-site.xml 


 
 
  
    hbase.cluster.distributed
    true
  
  
  
    hbase.zookeeper.quorum
    node1,node2,node3
  
  
  
    hbase.zoopkeeper.property.dataDir
    /data/zookeeper/data 
  
  
  
    hbase.rootdir
    hdfs://node1:9000/hbase
  
  
   
     hbase.tmp.dir
     /data/hbase/tmp
   
  
    hbase.unsafe.stream.capability.enforce
    false
  

  
  
    hbase.regionserver.wal.codec
    org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec
  

  
    hbase.column.max.version
    2
  
  
    hbase.regionserver.global.memstore.size
    0.2
  
  
    hbase.regionserver.global.memstore.size.lower.limit
    0.8
  

  
  
    hfile.block.cache.size
    0.2
  

  
  
    hbase.hregion.memstore.flush.size
    134217728
  

  
  
    dfs.namenode.service.handler.count
    48
  

  
  
    phoenix.coprocessor.maxServerCacheTimeToLiveMs
    300000
  

  
  
    hbase.regionserver.region.split.policy
    org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy
  

  
  
  
    hbase.hstore.compactionthreshold
    5
  
  
    hbase.hstore.compaction.max
    10
  
  
    hbase.hstore.blockingStoreFiles
    16
  
  
    hbase.hregion.majorcompaction
    0
  

  
    hbase.hstore.compaction.throughput.higher.bound
    20971520
    The default is 20 MB/sec
  
  
    hbase.hstore.compaction.throughput.lower.bound
    10485760
    The default is 10 MB/sec
  

#####################################################  

4、修改regionservers文件

在node1，node2，node3上操作

[hadoop@node1 conf]$ vim regionservers 
node1
node2
node3

#####################################################  

5、修改冲突jar包

hbase和hadoop都有slf4j-log4j12-1.7.30.jar包，启动hbase的时候会有冲突

修改hbase的jar包名。

[hadoop@node1 lib]$ cd /usr/local/hbase/lib/client-facing-thirdparty/
[hadoop@node1 client-facing-thirdparty]$ mv slf4j-log4j12-1.7.30.jar slf4j-log4j12-1.7.30.jar.bak

#####################################################  

6、查看相关进程是否启动

[root@node1 ~]# jps
42128 HRegionServer
42848 ResourceManager
33729 QuorumPeerMain
41893 HMaster
40664 NameNode
40824 DataNode
44442 Jps



[root@node2 ~]# jps
15410 HRegionServer
17013 Jps
15813 NodeManager
15021 DataNode
15133 SecondaryNameNode
1583 Bootstrap
12223 QuorumPeerMain




[root@node3 ~]# jps
13058 NodeManager
7766 QuorumPeerMain
13531 Jps
12715 HRegionServer
12412 DataNode

#####################################################  

7、访问hbase页面