ClickHouse单节点多实例部署高可用集群

环境说明

操作系统：ubuntu16.04
节点1：
192.168.18.61：ubuntu61
部署服务：clickhouserver（cs01-01）和 clickhouserver（cs01-02）
节点2：
192.168.18.63：ubuntu63
部署服务：clickhouserver（cs02-01）和 clickhouserver（cs02-02）
节点3：
192.168.18.62：ubuntu62
部署服务：zookeeper

cat /etc/hosts
192.168.18.61 ubuntu61
192.168.18.62 ubuntu62
192.168.18.63 ubuntu63

每个节点分别安装ClickHouse

略

单节点服务多实例

复制配置文件：

sudo cp /etc/clickhouse-server/config.xml /etc/clickhouse-server/config9001.xml
sudo cp /etc/clickhouse-server/user.xml /etc/clickhouse-server/user9001.xml
sudo cp /etc/systemd/system/clickhouse-server.service /etc/systemd/system/clickhouse-server9001.service

chmod 777  /etc/clickhouse-server/config9001.xml
chown clickhouse:clickhouse /etc/clickhouse-server/config9001.xml
chown clickhouse:clickhouse /etc/clickhouse-server/user9001.xml

修改配置：

/var/log/clickhouse-server/clickhouse-server9001.log
/var/log/clickhouse-server/clickhouse-server9001.err.log
8124
9001
9014
9015
9019
ubuntu61
::
/var/lib/clickhouse9001/
/var/lib/clickhouse9001/tmp/
/var/lib/clickhouse9001/user_files/

    users9001.xml

 
    /var/lib/clickhouse9001/access/

注意：
每个节点填写各自的hostname

ubuntu61

修改启动服务：

vi /etc/systemd/system/clickhouse-server9001.service
ExecStart=/usr/bin/clickhouse-server --config=/etc/clickhouse-server/config9001.xml --pid-file=/run/clickhouse-server/clickhouse-server9001.pid

启动服务：

systemctl start clickhouse-server9001
systemctl status clickhouse-server9001

集群配置

vi /etc/clickhouse-server/config.xml

    
        
            true
            
                ubuntu61
                9000
                default
                123456
            
            
                ubuntu63
                9001
                default
                
            
        
        
            true
            
                ubuntu63
                9000
                default
                
            
            
                ubuntu61
                9001
                default
                
            
        
    



ubuntu62
2181



        01
        01
        cluster01-01-1

每个节点的配置文件区别：
ubuntu61分片1、副本1

        01
        01
        cluster01-01-1

ubuntu61分片2、副本2

        01
        02
        cluster01-02-2

ubuntu63分片2、副本1

        01
        02
        cluster01-02-1

ubuntu63分片1、副本2

        01
        01
        cluster01-01-2

重启服务后，查看集群配置是否成功

 clickhouse-client --port 9000 --password 123456
 select * from system.clusters;

测试集群

1、分别登陆每个实例client，执行命令，创建数据库

CREATE DATABASE monchickey;
show databases;

2、每个实例，创建复制表

CREATE TABLE monchickey.image_label ( label_id UInt32,  label_name String,  insert_time Date) ENGINE = ReplicatedMergeTree('/clickhouse/tables/01-01/image_label','cluster01-01-1',insert_time, (label_id, insert_time), 8192);

CREATE TABLE monchickey.image_label ( label_id UInt32,  label_name String,  insert_time Date) ENGINE = ReplicatedMergeTree('/clickhouse/tables/01-02/image_label','cluster01-02-2',insert_time, (label_id, insert_time), 8192);

CREATE TABLE monchickey.image_label ( label_id UInt32,  label_name String,  insert_time Date) ENGINE = ReplicatedMergeTree('/clickhouse/tables/01-02/image_label','cluster01-02-1',insert_time, (label_id, insert_time), 8192);

CREATE TABLE monchickey.image_label ( label_id UInt32,  label_name String,  insert_time Date) ENGINE = ReplicatedMergeTree('/clickhouse/tables/01-01/image_label','cluster01-01-2',insert_time, (label_id, insert_time), 8192);

3、创建分布式表
分布式表只是作为一个查询引擎，本身不存储任何数据，查询时将sql发送到所有集群分片，然后进行进行处理和聚合后将结果返回给客户端
不需要在每个节点上都创建，按实际需要在指定的节点行创建即可

use monchickey;
CREATE TABLE image_label_all AS image_label ENGINE = Distributed(cluster_3s_1r, monchickey, image_label, rand());

4、插入数据，进行验证
在节点1，分片1上执行插入

use monchickey;
INSERT INTO monchickey.image_label (label_id,label_name,insert_time) VALUES (1,'aaa','2021-07-13');
INSERT INTO monchickey.image_label (label_id,label_name,insert_time) VALUES (2,'bbb','2021-07-13');

此时在其他分片节点上进行查询，能看到数据，说明集群搭建成功
在其他节点分片上进行插入

INSERT INTO monchickey.image_label (label_id,label_name,insert_time) VALUES (3,'ccc','2021-07-14');
INSERT INTO monchickey.image_label (label_id,label_name,insert_time) VALUES (4,'ddd','2021-07-15');
INSERT INTO monchickey.image_label (label_id,label_name,insert_time) VALUES (5,'eee','2021-07-16');

查看结果，观察数据变化

select * from image_label;
select * from image_label_all;