kafka 集群安装配置

主机
192.168.200.201
192.168.200.202
192.168.200.203

一,先安装zookeeper ,每台主机都安装
使用脚本,更改 myid 的值, 1对应200.201 ,2对应200.202,3对应200.203

```
#!/bin/bash

cd /data/ && wget http://archive.apache.org/dist/zookeeper/zookeeper-3.4.8/zookeeper-3.4.8.tar.gz
tar xf zookeeper-3.4.8.tar.gz && mv zookeeper-3.4.8 zookeeper

yum install -y java-1.8.0-openjdk*

cd zookeeper && mkdir {data,logs} && cd data && touch myid
echo "1" > myid 

cp /data/zookeeper/conf/zoo_sample.cfg /data/zookeeper/conf/zoo.cfg
sed -i "s/dataDir=\/tmp\/zookeeper/#dataDir=\/tmp\/zookeeper/g" /data/zookeeper/conf/zoo.cfg

echo "
dataLogDir=/data/zookeeper/logs
dataDir=/data/zookeeper/data
server.1=192.168.200.201:2888:2889
server.2=192.168.200.202:2888:2889
server.3=192.168.200.203:2888:2889
" >> /data/zookeeper/conf/zoo.cfg

cd /data/zookeeper/bin/ && ./zkServer.sh start

···

二,安装kafka ,每台主机都安装
1,先下载kafka 安装包
kafka_2.11-2.0.0 .tgz

2,解压和配置
tar xvf kafka_2.11-2.0.0 .tgz
mv kafka_2.11-2.0.0   /data/kafka
cd /data/kafka
vi /data/kafka/config/server.properties

修改配置如下(id和IP地址应该根据实际情况填写)
broker.id=1
listeners=PLAINTEXT://192.168.200.201:9092
zookeeper.connect=192.168.200.201:2181,192.168.200.202:2181,192.168.200.203:2181

在每台主机上分别启动kafka((要确保zookeeper已启动))
/usr/local/kafka/bin/kafka-server-start.sh -daemon config/server.properties 

在其中一台虚拟机(192.168.200.201)创建topic
/data/kafka/bin/kafka-topics.sh --create --zookeeper 192.168.200.201:2181 --replication-factor 3 --partitions 1 --topic test

查看topic
/data/kafka/bin/kafka-topics.sh --list --zookeeper 192.168.200.201:2181

验证是否成功,我们启动一个生产者,往里面输入信息
/data/kafka/bin/kafka-console-producer.sh --broker-list 192.168.200.201:9092 --topic test
this is test

启动一个客户端(消费者),看是否可以收到 "this is test  "
/data/kafka/bin/kafka-console-consumer.sh --bootstrap-server  localhost:9092 --topic test --from-beginning


 

你可能感兴趣的:(kafka)