Skip to content

Resolve "Improve logging around resource group acquisition"

What does this MR do and why?

Adds logs around resource group acquisition i.e.

  1. When there are no upcoming jobs to be processed
  2. When there are upcoming jobs but no free resources to acquire
  3. When assigning resource is successful or failed
  4. Number of acquired locks after the step above
  5. When a stale job failed to be released
  6. Number of released stale processables

Screenshots or screen recordings

{"severity":"INFO","time":"2023-02-10T23:02:06.079Z","correlation_id":"01GRYS10C2DZQ9J1G12ZVAD4YD","resource_group_id":1,"status":"released","result":{"stale_processables_count":0,"released_resources_count":0},"message":"released resources from stale processables"}
{"severity":"INFO","time":"2023-02-10T23:02:06.079Z","correlation_id":"01GRYS10C2DZQ9J1G12ZVAD4YD","resource_group_id":1,"status":"start","result":{},"message":"enqueueing jobs waiting for resource"}
{"severity":"INFO","time":"2023-02-10T23:02:06.095Z","correlation_id":"01GRYS10C2DZQ9J1G12ZVAD4YD","resource_group_id":1,"processable_id":288,"reason":"enqueue","message":"attempted assign resource to processable","success":true}
{"severity":"INFO","time":"2023-02-10T23:02:06.221Z","correlation_id":"01GRYS10C2DZQ9J1G12ZVAD4YD","resource_group_id":1,"status":"finish","result":{"free_resources":1,"upcoming_processables":"288","enqueued_jobs_waiting_for_resource":1},"message":"assigned resource from resource group"}
{"severity":"INFO","time":"2023-02-10T23:02:08.945Z","correlation_id":"01GRYS138MYEG32C0QEWMC4BDM","resource_group_id":1,"processable_id":288,"reason":"completed","message":"attempted release resource from processable","success":true}

How to set up and validate locally

  1. Add resource group to gitlab-ci.yml
  2. Trigger pipeline
  3. Check for logs in the log/ci_resource_groups_json.log file

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Related to #384180 (closed)

Edited by Halil Coban

Merge request reports