git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: chained operator with different parallelism question


Functions with different parallelism cannot be chained.
Chaining means that Functions are fused into a single operator and that records are passed by method calls (instead of serializing them into an in-memory or network channel).
Hence, chaining does not work if you have different parallelism.

Best, Fabian

2018-05-18 13:42 GMT+02:00 makeyang <riverbuilding@xxxxxxxxxxx>:
someStream.filter(...).map(...).map(...);
there operators are supposed to chained.
but what if there are set different parallelism like below:
someStream.filter(...).setParallelism(X).map(...).setParallelism(Y).map(...).setParallelism(Z);
X != Y != Z
what will happen?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/



( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-flink-users/msg09356.html on line 80
Call Stack
#TimeMemoryFunctionLocation
10.0007363576{main}( ).../msg09356.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-flink-users/msg09356.html on line 80
Call Stack
#TimeMemoryFunctionLocation
10.0007363576{main}( ).../msg09356.html:0