Make the StageUpdateWorker idempotent
Part of #178 (closed)
The StageUpdateWorker
processed 750k "duplicate" jobs the past 7 days, and spent 24 hours on that. Duplicate jobs are jobs that get scheduled when there is already a job in the queue for the same worker with the same arguments.
If the job was (marked as) idempotent, we would be able to deduplicate those jobs when they get scheduled.
This job updates the status of the stage based on all the builds in it. It is already idempotent, we can mark it as such and add the specs for it.
Edited by Bob Van Landuyt