git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Cancel a Running dag


Thanks Laura,
We are using the CeleryExecutor. Just wondering if marking the TaskInstances as failed in metadata store would also work.
-Raman

On 2018/04/12 16:27:00, Laura Lorenz <llorenz@xxxxxxxxxxxxxxxx> wrote: 
> I use the CeleryExecutor and have used a mix of `celery control` and
> messaging queue purges to kill the running tasks and prevent them from
> being picked up by workers again (respectively), and doctor the DagRun to
> failed to stop the scheduler from repopulating the message. I think if you
> are using the Local or Sequential Executor you'd have to kill the scheduler
> process.
> 
> Laura
> 
> On Thu, Apr 12, 2018 at 12:05 PM, Taylor Edmiston <tedmiston@xxxxxxxxx>
> wrote:
> 
> > I don't think killing a currently running task is possible today.
> >
> > Of course you can pause it from the CLI or web UI so that future runs don't
> > get triggered, but it sounds like that's not what you're looking for.
> >
> > Best,
> > Taylor
> >
> > *Taylor Edmiston*
> > Blog <http://blog.tedmiston.com> | Stack Overflow CV
> > <https://stackoverflow.com/story/taylor> | LinkedIn
> > <https://www.linkedin.com/in/tedmiston/> | AngelList
> > <https://angel.co/taylor>
> >
> >
> > On Thu, Apr 12, 2018 at 11:26 AM, ramandumcs@xxxxxxxxx <
> > ramandumcs@xxxxxxxxx
> > > wrote:
> >
> > > Hi All,
> > > We have a use case to cancel the already running DAG. So is there any
> > > recommended way to do so.
> > >
> > > Thanks,
> > > Raman
> > >
> >
> 



( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-airflow-development/msg03122.html on line 114
Call Stack
#TimeMemoryFunctionLocation
10.0012364648{main}( ).../msg03122.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-airflow-development/msg03122.html on line 114
Call Stack
#TimeMemoryFunctionLocation
10.0012364648{main}( ).../msg03122.html:0