[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Slide Window Compute Optimization


You are correct that with sliding windows you will have 3600 “open windows” at any point.
Could you describe a bit more what you want to do?

If you simply want to have an update of something like a counter every second, then you can 
implement your own logic with a ProcessFunction that allows to handle state and timers in a 
custom way (see [1]).

Hope this helps,


On Jul 5, 2018, at 12:12 PM, YennieChen88 <chenyanying3@xxxxxx> wrote:

   I want to use slide windows of 1 hour window size and 1 second step
size. I found that once a element arrives, it will be processed in 3600
windows serially through one thread. It takes serveral seconds to finish one
element processing,much more than my expection. Do I have any way to
optimizate it?
   Thank you very much for your reply.

Sent from: