Resolve "Improve logging around resource group acquisition"
What does this MR do and why?
Adds logs around resource group acquisition i.e.
- When there are no upcoming jobs to be processed
- When there are upcoming jobs but no free resources to acquire
- When assigning resource is successful or failed
- Number of acquired locks after the step above
- When a stale job failed to be released
- Number of released stale processables
Screenshots or screen recordings
{"severity":"INFO","time":"2023-02-10T23:02:06.079Z","correlation_id":"01GRYS10C2DZQ9J1G12ZVAD4YD","resource_group_id":1,"status":"released","result":{"stale_processables_count":0,"released_resources_count":0},"message":"released resources from stale processables"}
{"severity":"INFO","time":"2023-02-10T23:02:06.079Z","correlation_id":"01GRYS10C2DZQ9J1G12ZVAD4YD","resource_group_id":1,"status":"start","result":{},"message":"enqueueing jobs waiting for resource"}
{"severity":"INFO","time":"2023-02-10T23:02:06.095Z","correlation_id":"01GRYS10C2DZQ9J1G12ZVAD4YD","resource_group_id":1,"processable_id":288,"reason":"enqueue","message":"attempted assign resource to processable","success":true}
{"severity":"INFO","time":"2023-02-10T23:02:06.221Z","correlation_id":"01GRYS10C2DZQ9J1G12ZVAD4YD","resource_group_id":1,"status":"finish","result":{"free_resources":1,"upcoming_processables":"288","enqueued_jobs_waiting_for_resource":1},"message":"assigned resource from resource group"}
{"severity":"INFO","time":"2023-02-10T23:02:08.945Z","correlation_id":"01GRYS138MYEG32C0QEWMC4BDM","resource_group_id":1,"processable_id":288,"reason":"completed","message":"attempted release resource from processable","success":true}
How to set up and validate locally
- Add resource group to
gitlab-ci.yml
- Trigger pipeline
- Check for logs in the
log/ci_resource_groups_json.log
file
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Related to #384180 (closed)
Edited by Halil Coban