git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Managing long-running pipelines


Hi Pino,

If you have not figured it already, for Dataflow runner, this API may help.

-B

On Mon, Apr 16, 2018 at 5:21 PM Pino de Candia <giuseppe.decandia@xxxxxxxxx> wrote:
Hi Folks,

are there any systems that can help manage Beam pipelines? I'm looking for something that can tell me what pipelines are running, stop/restart a pipeline, modify a pipeline (e.g. to derive additional results from the same inputs).

If nothing of the sort exists for Beam, how about for specific runners?

thanks!
Pino de Candia


( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-beam-users/msg02179.html on line 74
Call Stack
#TimeMemoryFunctionLocation
10.0012368664{main}( ).../msg02179.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-beam-users/msg02179.html on line 74
Call Stack
#TimeMemoryFunctionLocation
10.0012368664{main}( ).../msg02179.html:0