kafka-副本扩容

kafka-副本扩容

创建 主题

./bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic test2
Created topic test2.

./bin/kafka-topics.sh --bootstrap-server localhost:9092 --list
__consumer_offsets
test2

./bin/kafka-topics.sh --bootstrap-server localhost:9092  --describe --topic test2
Topic: test2    TopicId: WdrAo9N9QkuhV0kWGvhV7w PartitionCount: 1       ReplicationFactor: 1    Configs: segment.bytes=1073741824
        Topic: test2    Partition: 0    Leader: 3       Replicas: 3     Isr: 3

副本扩容

使用 /bin/kafka-reassign-partitions.sh 进行副本扩容

$ echo '{"version":1,"partitions":[{"topic":"test2","partition":0,"replicas" :[1,2,3]}]}' > increase-replication-factor.json

./bin/kafka-reassign-partitions.sh --bootstrap-server localhost:9092 --reassignment-json-file increase-replication-factor.json --execute
Current partition replica assignment

{"version":1,"partitions":[{"topic":"test2","partition":0,"replicas":[3],"log_dirs":["any"]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started partition reassignment for test2-0

./bin/kafka-topics.sh --bootstrap-server localhost:9092  --describe --topic test2
Topic: test2    TopicId: WdrAo9N9QkuhV0kWGvhV7w PartitionCount: 1       ReplicationFactor: 3    Configs: segment.bytes=1073741824
        Topic: test2    Partition: 0    Leader: 3       Replicas: 1,2,3 Isr: 3,1,2

可以发现副本数已经变成3个