git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Conceptual question


We are still pretty new to Flink and I have a conceptual / DevOps question.

When a job is modified and we want to deploy the new version, what is the preferred method?  Our jobs have a lot of keyed state.

If we use snapshots we have old state that may no longer apply to the new pipeline.
If we start a new job we can reprocess historical data from Kafka, but that can be very resource heavy for a while.

Is there an option I am missing?  Are there facilities to “patch” or “purge” selectively the keyed state?

Michael


( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-flink-users/msg09718.html on line 78
Call Stack
#TimeMemoryFunctionLocation
10.0005362888{main}( ).../msg09718.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-flink-users/msg09718.html on line 78
Call Stack
#TimeMemoryFunctionLocation
10.0005362888{main}( ).../msg09718.html:0