flinksql bug:In ‘hash‘ distribution mode with equality fields set, partition field ‘1000: ymd_bucket

报错信息:java.lang.IllegalStateException: In ‘hash’ distribution mode with equality fields set, partition field ‘1000: ymd_bucket: bucket32’ should be included in equality fields: ‘[distinct_id, tip_page_id, rwk]’

场景

flinksql 读取topic 插入iceberg

原因

iceberg的分区字段 必须从 主键中选择

你可能感兴趣的:(报错调试记录,哈希算法,flink,大数据)