git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Airflow - YARN as an executor?


With Hadoop 3's Docker on YARN support, I think YARN becomes
somewhat a competitor for Kubernetes.

Great job on adding k8s support to Airflow.

Very similarly I see Airflow could integrate with YARN and use
its infrastructure as an "executor" .. have anyone explored feasibility of
this approach?


Thanks!
Ruslan Dautkhanov


( ! ) Warning: include(msgfooter.php): failed to open stream: No such file or directory in /var/www/git/apache-airflow-development/msg03182.html on line 80
Call Stack
#TimeMemoryFunctionLocation
10.0007362616{main}( ).../msg03182.html:0

( ! ) Warning: include(): Failed opening 'msgfooter.php' for inclusion (include_path='.:/var/www/git') in /var/www/git/apache-airflow-development/msg03182.html on line 80
Call Stack
#TimeMemoryFunctionLocation
10.0007362616{main}( ).../msg03182.html:0