git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Table API/SQL] Finding missing spots to resolve why 'no watermark' is presented in Flink UI


Sorry I forgot to mention the version: Flink 1.5.0, and I ran the app in IntelliJ, not tried from cluster.

2018년 7월 4일 (수) 오후 5:15, Jungtaek Lim <kabhwan@xxxxxxxxx>님이 작성:
Hi Flink users,

I'm new to Flink and trying to evaluate couple of streaming frameworks via implementing same apps.

While implementing apps with both Table API and SQL, I found there's 'no watermark' presented in Flink UI, whereas I had been struggling to apply row time attribute.

For example, below is one of TableSource implementation which wraps DataStream reading from Kafka.


(Actually I ended up implementing TableSource to address adding rowtime attribute as well as reading and parsing JSON. I'd be really happy if someone can guide a way to get rid of needed of custom implementation of TableSource.)

and below is one of app I implemented:


Btw, I'm about to experiment side-output with late events, but is it possible to leverage side-output with Table API / SQL? Looks like DataStream exposes late events only when it's converted to AllWindowedStream.

Thanks in advance!

Best Regards,
Jungtaek Lim (HeartSaVioR)