git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

nova-api missing heartbeats to rabbitmq


On 3/24/20 13:04, Alex Schultz wrote:
> On Tue, Mar 24, 2020 at 1:11 PM Satish Patel <satish.txt at gmail.com> wrote:
>>
>> Folks,
>>
>> Recently i am seeing lots of error message in rabbitmq logs saying
>> missing heartbeats from nova-api nodes, I am not seeing any issue at
>> functionality level as everything working fine but just noticed those
>> error and trying to find root cause of it.
>>
>> 172.28.15.125  nova-api server
>> 172.28.15.192  rabbitmq server
>>
>> on rabbit.log
>>
>> 2020-03-24 12:21:41.389 [error] <0.29772.4418> closing AMQP connection
>> <0.29772.4418> (172.28.15.125:42656 -> 172.28.15.192:5671 -
>> uwsgi:32419:9b8a323b-653d-4585-9916-d52b3fd81d59):
>> missed heartbeats from client, timeout: 60s
>>
>> on nova-api.log
>>
>> 2020-03-24 12:19:06.554 32435 ERROR
>> oslo.messaging._drivers.impl_rabbit [-]
>> [4b8adff0-ff9f-4863-a939-537d391e5d9e] AMQP server on
>> 172.28.15.192:5671 is unreachable: [Errno 104] Connection reset by
>> peer. Trying again in 1 seconds.: error: [Errno 104] Connection reset
>> by peer
>>
> 
> 
> ooo I know this one!  See this archive thread:
> http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005305.html
> 
> https://bugs.launchpad.net/nova/+bug/1825584

One more link for the pile:

https://docs.openstack.org/releasenotes/nova/stein.html#known-issues

This ^ is linked from the launchpad issue but I link it here directly to 
make it easier.

Cheers,
-melanie