NameNode启用HA主备节点进行切换,Hbase启动RegionServers失败

打印日志:

2018-03-13 17:08:49,418 INFO  [RS_OPEN_REGION-C2bdm3:16020-16] coordination.ZkOpenRegionCoordination: Opening of region {ENCODED => c5112e862e17377d2737596d6d5ddd0c, NAME => 'KYLIN_CY40CLW8S7,,1515476756805.c5112e862e17377d2737596d6d5ddd0c.', STARTKEY => '', ENDKEY => ''} failed, transitioning from OFFLINE to FAILED_OPEN in ZK, expecting version 0

2018-03-13 17:08:49,410 ERROR [RS_OPEN_REGION-C2bdm3:16020-7] handler.OpenRegionHandler: Failed open of region=KYLIN_HDRNQP569F,,1515477559989.afd924b7ef69c26dc292b6dde6226e21., starting to roll back the global memstore size.
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby
        at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:87)
        at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:2006)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1378)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo(FSNamesystem.java:4106)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo(NameNodeRpcServer.java:1137)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo(ClientNamenodeProtocolServerSideTranslatorPB.java:854)
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:640)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:982)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2351)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2347)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2345)


        at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1554)
        at org.apache.hadoop.ipc.Client.call(Client.java:1498)
        at org.apache.hadoop.ipc.Client.call(Client.java:1398)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
        at com.sun.proxy.$Proxy16.getFileInfo(Unknown Source)

        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:818)


个人参考自己之前的解决办法(切换回NameNode的主备节点的方法):

https://blog.csdn.net/ZhouyuanLinli/article/details/79396829

后来猜测是不是Kylin中数据引起的,之前未启用HA时添加的,因为Kylin这些测试数据不太重要,所以在Hbase中删除:

hbase(main):006:0> disable_all 'KYLIN_.*'

hbase(main):009:0> drop_all 'KYLIN_.*'

然后在ambari界面重启下zookerper,再重启HBase,结果正常启动,果然是Kylin数据有影响

你可能感兴趣的:(HBase)