[jira] [Created] (FLINK-11035) Notify data available to network stack immediately after finishing BufferBuilder
zhijiang created FLINK-11035:
Summary: Notify data available to network stack immediately after finishing BufferBuilder
Issue Type: Sub-task
Affects Versions: 1.8.0
The data availability notification for network relies on whether there are finished _BufferBuilder_ or flush triggered. If flush is not triggered and the first _BufferBuilder_ enqueues into the subpartition, although this _BufferBuilder_ is finished on _RecordWriter_ side, it has to rely on enqueuing the second _BufferBuilder_ to trigger notification available. It may bring some delays for transporting the finished _BufferBuilder_ in network, especially there has a blocking operation for requesting the second _BufferBuilder_ from pool.
Supposing there is only one available buffer in LocalBufferPool in extreme scenarios, if the first _BufferBuilder_ is not transported and recycled, the requesting for second _BufferBuilder_ will be blocked all the time.
I propose to add a _notifyBufferFinished_ method in _ResultPartitionWriter_ interface, then _RecordWriter_ can notify via it after _BufferBuilder_ finished_._
This message was sent by Atlassian JIRA