git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

k8s example DAGs


 Is it possible to make kubernetes examples installed optionally?

We don't use Kubernetes and a bare Airflow install fills logs with
following :

2018-04-22 19:49:04,718 ERROR - Failed to import:
> /opt/airflow/airflow-20180420/src/apache-airflow/airflow/
> example_dags/example_kubernetes_operator.py
> Traceback (most recent call last):
>   File "/opt/airflow/airflow-20180420/src/apache-airflow/airflow/models.py",
> line 300, in process_file
>     m = imp.load_source(mod_name, filepath)
>   File "/opt/airflow/airflow-20180420/src/apache-airflow/
> airflow/example_dags/example_kubernetes_operator.py", line 19, in <module>
>     from airflow.contrib.operators.kubernetes_pod_operator import
> KubernetesPodOperator
>   File "/opt/airflow/airflow-20180420/src/apache-airflow/
> airflow/contrib/operators/kubernetes_pod_operator.py", line 21, in
> <module>
>     from airflow.contrib.kubernetes import kube_client, pod_generator,
> pod_launcher
>   File "/opt/airflow/airflow-20180420/src/apache-airflow/
> airflow/contrib/kubernetes/pod_launcher.py", line 25, in <module>
>     from kubernetes import watch
> ImportError: No module named kubernetes


Would be great to make examples driven by what modules installed if they
have external dependencies,


Thanks!

Ruslan Dautkhanov