flink1.12.4消费kafka 报错 The coordinator is not available

报错


You should retry committing the latest consumed offsets.

Caused by: org.apache.kafka.common.errors.CoordinatorNotAvailableException: The coordinator is not available.

但是任务还在正常跑.


开源bug

[FLINK-28060] Kafka Commit on checkpointing fails repeatedly after a broker restart - ASF JIRA 

导致的现象

任务还在跑 认识消费kafka的偏移量没有随着checkpoint提交到kafka broker. 会导致如果监控任务监控kafka broker存储的偏移量,那么就会任务你的任务一致没有消费.

解决

重启任务 

升级到flink 1.16.x

 

你可能感兴趣的:(Flink,kafka,flink)