git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[jira] [Created] (FLINK-9691) Modify run loop in Kinesis ShardConsumer to not sleep for a fixed fetchIntervalMillis


Lakshmi Rao created FLINK-9691:
----------------------------------

             Summary: Modify run loop in Kinesis ShardConsumer to not sleep for a fixed fetchIntervalMillis
                 Key: FLINK-9691
                 URL: https://issues.apache.org/jira/browse/FLINK-9691
             Project: Flink
          Issue Type: Improvement
          Components: Kinesis Connector
            Reporter: Lakshmi Rao


Currently the ShardConsumer in the Kinesis connector sleeps for a fixed [fetchIntervalMillis|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardConsumer.java#L210] resulting in the shard consumer sleeping for more time than necessary and not optimally reading from Kinesis. It should only be sleeping for (fetchIntervalMillis - time taken to process records) before making the subsequent getRecords call. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)



( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-flink-development/msg07876.html on line 88
Call Stack
#TimeMemoryFunctionLocation
10.0006364664{main}( ).../msg07876.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-flink-development/msg07876.html on line 88
Call Stack
#TimeMemoryFunctionLocation
10.0006364664{main}( ).../msg07876.html:0