git.net

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Senlin] Splitting senlin-engine into three services


We are looking at merging this in a few days if there is no additional feedback.

Also, in case someone has experience with adding new services to a project. Is there a general way of requesting rpms etc to be updated for the next release to support the new services? Especially for the workflows that are handled outside of the official openstack repos.
________________________________
From: Erik Olof Gunnar Andersson <eandersson at blizzard.com>
Sent: Monday, November 4, 2019 5:11 PM
To: openstack-discuss at lists.openstack.org <openstack-discuss at lists.openstack.org>
Cc: Duc Truong <dtruong at blizzard.com>
Subject: [Senlin] Splitting senlin-engine into three services

We are looking into splitting the senlin-engine into three components (senlin-conductor, senlin-engine and senlin-health-manager) and wanted to get some feedback.

The main goal here is to make the components more resilient and to reduce the number of threads per worker. Each one of the components already had it's own thread
pool and in theory each worker could end up with thousands of thread.

In the current version (Train) the engine process hosts these services.
https://github.com/openstack/senlin/blob/stable/train/senlin/engine/dispatcher.py#L31<https://urldefense.com/v3/__https://github.com/openstack/senlin/blob/stable/train/senlin/engine/dispatcher.py*L31__;Iw!2E0gRdhhnqPNNL0!3beNVRHaycRfV2OvKXmcXKA-_6IY9M0ZPSl41PZIdbysXr8VPx_iQYFi6E2ibmpScw$>
https://github.com/openstack/senlin/blob/stable/train/senlin/engine/health_manager.py#L865<https://urldefense.com/v3/__https://github.com/openstack/senlin/blob/stable/train/senlin/engine/health_manager.py*L865__;Iw!2E0gRdhhnqPNNL0!3beNVRHaycRfV2OvKXmcXKA-_6IY9M0ZPSl41PZIdbysXr8VPx_iQYFi6E1RSxLiRg$>
https://github.com/openstack/senlin/blob/stable/train/senlin/engine/service.py#L79<https://urldefense.com/v3/__https://github.com/openstack/senlin/blob/stable/train/senlin/engine/service.py*L79__;Iw!2E0gRdhhnqPNNL0!3beNVRHaycRfV2OvKXmcXKA-_6IY9M0ZPSl41PZIdbysXr8VPx_iQYFi6E3gBevNpA$>

In my patch we move two our of these out of the engine and into it's own service namespace.

Split engine service into three services
https://review.opendev.org/#/c/688784/<https://urldefense.com/v3/__https://review.opendev.org/*/c/688784/__;Iw!2E0gRdhhnqPNNL0!3beNVRHaycRfV2OvKXmcXKA-_6IY9M0ZPSl41PZIdbysXr8VPx_iQYFi6E2L1WTA-Q$>

Please feel free to comment on the patch set, or let reply to this email with general feedback or concerns.

 Best Regards, Erik Olof Gunnar Andersson



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20191110/8f149b55/attachment-0001.html>