kudu安装之Master config (gd92s3:7051) has no leader

ERROR: ImpalaRuntimeException: Error creating Kudu table 'impala::kudu_custtag.cust_indexs01'

CAUSED BY: NonRecoverableException: Couldn't find a valid master in (gd92s3:7051). Exceptions received: [org.apache.kudu.client.NonRecoverableException: can not complete before timeout: KuduRpc(method=ConnectToMaster, tablet=null, attempt=74, DeadlineTracker(timeout=179138, elapsed=177887), Traces: [0ms] sending RPC to server master-gd92s3:7051, [28838ms] delaying RPC due to Illegal state: connection is terminated, [28979ms] querying master, [29923ms] sending RPC to server master-gd92s3:7051, [44779ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x37f9b307, /172.16.14.94:37030 => gd92s3/172.16.14.92:7051], [45142ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x37f9b307, /172.16.14.94:37030 => gd92s3/172.16.14.92:7051], [45148ms] querying master, [45155ms] sending RPC to server master-gd92s3:7051, [45622ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xb4fdc213, /172.16.14.94:37032 => gd92s3/172.16.14.92:7051], [45680ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xb4fdc213, /172.16.14.94:37032 => gd92s3/172.16.14.92:7051], [45690ms] querying master, [45739ms] sending RPC to server master-gd92s3:7051, [45879ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x4a89e48a, /172.16.14.94:37034 => gd92s3/172.16.14.92:7051], [45914ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x4a89e48a, /172.16.14.94:37034 => gd92s3/172.16.14.92:7051], [45928ms] querying master, [45938ms] sending RPC to server master-gd92s3:7051, [45978ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x91657fda, /172.16.14.94:37036 => gd92s3/172.16.14.92:7051], [46040ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x91657fda, /172.16.14.94:37036 => gd92s3/172.16.14.92:7051], [46048ms] querying master, [46095ms] sending RPC to server master-gd92s3:7051, [46426ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x83470889, /172.16.14.94:37038 => gd92s3/172.16.14.92:7051], [46466ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x83470889, /172.16.14.94:37038 => gd92s3/172.16.14.92:7051], [46509ms] querying master, [46513ms] sending RPC to server master-gd92s3:7051, [46611ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x9f9c3e82, /172.16.14.94:37040 => gd92s3/172.16.14.92:7051], [46801ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x9f9c3e82, /172.16.14.94:37040 => gd92s3/172.16.14.92:7051], [46868ms] querying master, [46872ms] sending RPC to server master-gd92s3:7051, [46889ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x7c170a07, /172.16.14.94:37042 => gd92s3/172.16.14.92:7051], [46890ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x7c170a07, /172.16.14.94:37042 => gd92s3/172.16.14.92:7051], [47008ms] querying master, [47013ms] sending RPC to server master-gd92s3:7051, [47036ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x0575a8c4, /172.16.14.94:37044 => gd92s3/172.16.14.92:7051], [47042ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x0575a8c4, /172.16.14.94:37044 => gd92s3/172.16.14.92:7051], [47208ms] querying master, [47209ms] sending RPC to server master-gd92s3:7051, [47229ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x3a4b1593, /172.16.14.94:37046 => gd92s3/172.16.14.92:7051], [47247ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x3a4b1593, /172.16.14.94:37046 => gd92s3/172.16.14.92:7051], [47948ms] querying master, [47949ms] sending RPC to server master-gd92s3:7051, [48017ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xc489d58e, /172.16.14.94:37048 => gd92s3/172.16.14.92:7051], [48035ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xc489d58e, /172.16.14.94:37048 => gd92s3/172.16.14.92:7051], [48310ms] querying master, [48310ms] sending RPC to server master-gd92s3:7051, [48363ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xc2713591, /172.16.14.94:37050 => gd92s3/172.16.14.92:7051], [48405ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xc2713591, /172.16.14.94:37050 => gd92s3/172.16.14.92:7051], [49069ms] querying master, [49069ms] sending RPC to server master-gd92s3:7051, [49160ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xf8f4ec54, /172.16.14.94:37054 => gd92s3/172.16.14.92:7051], [49202ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xf8f4ec54, /172.16.14.94:37054 => gd92s3/172.16.14.92:7051], [52908ms] querying master, [52911ms] sending RPC to server master-gd92s3:7051, [57722ms] received from server master-gd92s3:7051 response Network error: connection disconnected, [57728ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection disconnected, [59308ms] querying master, [59308ms] sending RPC to server master-gd92s3:7051, [59342ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xacb8a5fd, /172.16.14.94:37062 => gd92s3/172.16.14.92:7051], [59346ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xacb8a5fd, /172.16.14.94:37062 => gd92s3/172.16.14.92:7051], [60169ms] querying master, [60197ms] sending RPC to server master-gd92s3:7051, [60277ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x436492ba, /172.16.14.94:37064 => gd92s3/172.16.14.92:7051], [60921ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x436492ba, /172.16.14.94:37064 => gd92s3/172.16.14.92:7051], [61728ms] querying master, [61729ms] sending RPC to server master-gd92s3:7051, [61763ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x417f4289, /172.16.14.94:37066 => gd92s3/172.16.14.92:7051], [61764ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x417f4289, /172.16.14.94:37066 => gd92s3/172.16.14.92:7051], [62488ms] querying master, [62489ms] sending RPC to server master-gd92s3:7051, [62493ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xbecfdf81, /172.16.14.94:37068 => gd92s3/172.16.14.92:7051], [62495ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xbecfdf81, /172.16.14.94:37068 => gd92s3/172.16.14.92:7051], [64349ms] querying master, [64349ms] sending RPC to server master-gd92s3:7051, [64370ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xd346ebe3, /172.16.14.94:37070 => gd92s3/172.16.14.92:7051], [64373ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xd346ebe3, /172.16.14.94:37070 => gd92s3/172.16.14.92:7051], [66828ms] querying master, [66829ms] sending RPC to server master-gd92s3:7051, [66861ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xc9efae5a, /172.16.14.94:37072 => gd92s3/172.16.14.92:7051], [66863ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0xc9efae5a, /172.16.14.94:37072 => gd92s3/172.16.14.92:7051], [70508ms] querying master, [70523ms] sending RPC to server master-gd92s3:7051, [70577ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x8a057887, /172.16.14.94:37074 => gd92s3/172.16.14.92:7051], [70601ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x8a057887, /172.16.14.94:37074 => gd92s3/172.16.14.92:7051], [73448ms] querying master, [73460ms] sending RPC to server master-gd92s3:7051, [73485ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x06996580, /172.16.14.94:37076 => gd92s3/172.16.14.92:7051], [73486ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x06996580, /172.16.14.94:37076 => gd92s3/172.16.14.92:7051], [74168ms] querying master, [74169ms] sending RPC to server master-gd92s3:7051, [74180ms] received from server master-gd92s3:7051 response Network error: connection disconnected, [74181ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection disconnected, [77868ms] querying master, [77868ms] sending RPC to server master-gd92s3:7051, [77877ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x85d07f7e, /172.16.14.94:37080 => gd92s3/172.16.14.92:7051], [77878ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x85d07f7e, /172.16.14.94:37080 => gd92s3/172.16.14.92:7051], [78448ms] querying master, [78456ms] sending RPC to server master-gd92s3:7051, [78471ms] received from server master-gd92s3:7051 response Network error: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x70d53875, /172.16.14.94:37082 => gd92s3/172.16.14.92:7051], [78472ms] delaying RPC due to Service unavailable: Master config (gd92s3:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-gd92s3:7051(gd92s3:7051)] unexpected exception from downstream on [id: 0x70d53875, /172.16.14.94:37082 => gd92s3/172.16.14.92:7051], [81588ms] querying master, [81605ms] sending RPC to server master-gd92s3:7051, [81612ms] trace too long, truncated)]

 

 截的日志有点长，不好意思，具体的错误还要看kuduUI的logs，kuduUI里面的的日志明确指出缺少sasl,所以装个sals就可以了，具体命令如下：

           yum install -y gcc python-devel
           yum install -y cyrus-sasl*