git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Buffer congestion in a downstream operator hangs SourceContext.collect in an (in?)finite loop


Hello,

I have a scenario, where FlinkKafkaProducer instance isn't able to write to a certain partition (the broker for the partition is down, or whatever), it's buffer eventually becomes full, and the whole topology freezes, because the root source (nonparallel) get's blocked on it, however it could still serve other branches/partitions.

Please see https://stackoverflow.com/questions/50667499/how-to-keep-broadcasting-from-non-parallel-source-when-one-of-the-downstreams-ha for more details. 

What can be wrong, could you suggest anything?

Respectfully,
Oleh.



( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-flink-users/msg09607.html on line 73
Call Stack
#TimeMemoryFunctionLocation
10.0008368736{main}( ).../msg09607.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-flink-users/msg09607.html on line 73
Call Stack
#TimeMemoryFunctionLocation
10.0008368736{main}( ).../msg09607.html:0