flink1.15.0消费kafka 报错 The coordinator is not available.

报错

You should retry committing the latest consumed offsets.

Caused by: org.apache.kafka.common.errors.CoordinatorNotAvailableException: The coordinator is not available.

但是任务还在正常跑.

开源bug

[FLINK-28060] Kafka Commit on checkpointing fails repeatedly after a broker restart - ASF JIRA

导致的现象

任务还在跑 认识消费kafka的偏移量没有随着checkpoint提交到kafka broker. 会导致如果监控任务监控kafka broker存储的偏移量,那么就会任务你的任务一致没有消费.

解决

重启任务 

升级到flink 1.16.x

你可能感兴趣的:(free,kafka,分布式)