git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Fwd: [jira] [Assigned] (AIRFLOW-3099) Errors raised when some blocs are missing in airflow.cfg


Hi Holden Karau,

Not sure on what is happening, but seems like the dashboard you are working
on is setting assignee. Pinging you just in-case if you aren't aware :)

---------- Forwarded message ---------
From: Holden Karau's magical unicorn (JIRA) <jira@xxxxxxxxxx>
Date: Fri, Sep 21, 2018 at 11:31 PM
Subject: [jira] [Assigned] (AIRFLOW-3099) Errors raised when some blocs are
missing in airflow.cfg
To: <kaxilnaik@xxxxxxxxx>



     [
https://issues.apache.org/jira/browse/AIRFLOW-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Holden Karau's magical unicorn reassigned AIRFLOW-3099:
-------------------------------------------------------

    Assignee: Holden Karau's magical unicorn  (was: Kaxil Naik)

> Errors raised when some blocs are missing in airflow.cfg
> --------------------------------------------------------
>
>                 Key: AIRFLOW-3099
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3099
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: configuration
>    Affects Versions: 1.10.0
>            Reporter: Christophe
>            Assignee: Holden Karau's magical unicorn
>            Priority: Minor
>             Fix For: 1.10.1
>
>
> When we upgrade from a version of airflow to another one and new config
bloc are available or if we delete useless blocs, lots of errors are raised
if we don't have some blocs in airflow.cfg file.
> We need to avoid these errors for non-required blocs.
>
> For the record logs (not exhaustive):
>
> {noformat}
> [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option
sasl_enabled does not exist in the config!
> [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option host
does not exist in the config!
> [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option port
does not exist in the config!
> [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option
username does not exist in the config!
> [2018-09-21 10:49:37,727] {cli.py:464} ERROR - Section atlas Option
password does not exist in the config!
> [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section hive Option
default_hive_mapred_queue does not exist in the config!
> [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
master does not exist in the config!
> [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
framework_name does not exist in the config!
> [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
task_cpu does not exist in the config!
> [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
task_memory does not exist in the config!
> [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
checkpoint does not exist in the config!
> [2018-09-21 10:49:37,728] {cli.py:464} ERROR - Section mesos Option
authenticate does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section elasticsearch
Option elasticsearch_host does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section elasticsearch
Option elasticsearch_log_id_template does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section elasticsearch
Option elasticsearch_end_of_log_mark does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes Option
worker_container_repository does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes Option
worker_container_tag does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes Option
delete_worker_pods does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes Option
namespace does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes Option
airflow_configmap does not exist in the config!
> [2018-09-21 10:49:37,729] {cli.py:464} ERROR - Section kubernetes Option
dags_volume_subpath does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
dags_volume_claim does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
logs_volume_subpath does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
logs_volume_claim does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
git_repo does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
git_branch does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
git_user does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
git_password does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
git_subpath does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
git_sync_container_repository does not exist in the config!
> [2018-09-21 10:49:37,730] {cli.py:464} ERROR - Section kubernetes Option
git_sync_container_tag does not exist in the config!
> [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes Option
git_sync_init_container_name does not exist in the config!
> [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes Option
worker_service_account_name does not exist in the config!
> [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes Option
image_pull_secrets does not exist in the config!
> [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes Option
gcp_service_account_keys does not exist in the config!
> [2018-09-21 10:49:37,731] {cli.py:464} ERROR - Section kubernetes Option
in_cluster does not exist in the config!{noformat}
>



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


-- 
*Kaxil Naik*
*Big Data Consultant *@ *Data Reply UK*
*Certified *Google Cloud Data Engineer | *Certified* Apache Spark & Neo4j
Developer
*Phone: *+44 (0) 74820 88992
*LinkedIn*: https://www.linkedin.com/in/kaxil