git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: SqlAlchemy Pool config parameters to minimize connectivity issue impact


Hi Raman,
Would you elaborate a bit more on what exactly is the connectivity issues
that you were facing and which version of Airflow are you on? We previously
had some connectivity issue when the # of connection was too large and we
had it fixed with this PR
<https://github.com/apache/incubator-airflow/pull/3336>.

Cheers,
Kevin Y

On Tue, Sep 25, 2018 at 11:57 PM ramandumcs@xxxxxxxxx <ramandumcs@xxxxxxxxx>
wrote:

> Hi All,
>
> We are observing sometimes Dag tasks get failed because of some
> connectivity issues with Mysql server.
> So Are there any recommended settings for mysql pool's related parameters
> like
> sql_alchemy_pool_size = 5
> sql_alchemy_pool_recycle = 3600
> to minimise  the connectivity issue impact.
>
> Thanks,
> Raman Gupta
>