logstash到kafka：生产者发送的消息过大的报错

1.报错提示

KafkaProducer.send() failed: org.apache.kafka.common.errors.RecordBatchTooLargeException: The request included message batch larger than the configured segment size on the server. {:exception=>java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.RecordBatchTooLargeException: The request included message batch larger than the configured segment size on the server.}

2 .错误原因：生产者发送的消息过大，大于broker的配置,

3 解决方法：在服务端的配置文件server.properties加上的message.max.bytes配置, 数值可以根据实际需要修改,单位是byte.

vim  /usr/local/kafka/config/server.properties

message.max.bytes=12695150
compression.codec=snappy
max.partition.fetch.bytes=4194304

vim /usr/local/kafka/config/producer.properties 

max.request.size=12695150

• 重启kafka服务： systemctl restart zookeeper kafka