Flink savepoint | checkpoint 恢复

savepoint
手动触发 savepoint
root@flink-jobmanager-0:/opt/flink/bin# ./flink savepoint 0d69ad4b526c7d7e491357bc842b1e75 hdfs://hdfs-namenode-service:9000/flink-savepoints
...
Triggering savepoint for job 0d69ad4b526c7d7e491357bc842b1e75.
Waiting for response...
Savepoint completed. Path: hdfs://hdfs-namenode-service:9000/flink-savepoints/savepoint-0d69ad-e7f300dcf256
You can resume your program from this savepoint with the run command.

flink on yarn savepoint
root@flink-jobmanager-0:/opt/flink/bin# ./flink stop 7c32acbd7c4e79599e0d3e2cddb2a58d -yid application_1659410541398_0026 -p hdfs://hdfs-namenode-service:9000/flink-savepoints

...
Savepoint completed. Path: hdfs://hdfs-namenode-service:9000/flink-savepoints/savepoint-7c32ac-28eaf6dd5e64

savepoint 恢复

./flink/bin/flink run -m yarn-cluster -s hdfs://hdfs-namenode-service:9000/flink-savepoints/savepoint-0d6                      9ad-e7f300dcf256 -c com.nufront.bigdata.v2x.job.V2xRTDataPersistenceToHDFS /opt/v2x-1.0-SNAPSHOT.jar

Flink savepoint | checkpoint 恢复_第1张图片

checkpoint
checkpoint 恢复

--allowNonRestoredState 程序发生修改
Flink savepoint | checkpoint 恢复_第2张图片

root@flink-jobmanager-0:/opt# /opt/flink/bin/flink run -m flink-jobmanager:8081 -s hdfs://hdfs-namenode-service:9000//flink-checkpoints/1e403e273864a487c2f6b2436983d0a2/chk-668 --allowNonRestoredState  -c com.nufront.bigdata.v2x.job.V2xRTDataStramSplit2KafkaState /opt/v2x-1.0-SNAPSHOT.jar consumer.test.group.20221115.0002
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/flink/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/flink/lib/phoenix-5.0.0-HBase-2.0-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/flink/lib/phoenix-core-5.0.0-HBase-2.0-jar-with-dependencies-with-hbase-site.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
Job has been submitted with JobID 6cb8b4d4d157472719b85e11efa20083

Flink savepoint | checkpoint 恢复_第3张图片

参考:Flink操作命令基础整理

你可能感兴趣的:(Flink,flink,大数据,hadoop)