Backend: Retry subsequent jobs if upstream job is retried

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

Problem

In a pipeline, a job retries in isolation, however, there are cases when a job is dependent on a result of previous jobs so retying a job in isolation will not achieve the desired goal

Description

Currently, if someone retries a job, it is retried in isolation. If subsequent jobs depend on the results of that retried job, say via an artifact or image in the container registry, we should automatically retry all dependent jobs. Comments elsewhere have suggested that we want an option to specify which jobs should be retried or not, but I posit that we already have this declaration via artifacts. Unfortunately, artifacts don't encompass image dependencies yet. Perhaps we could augment dependencies to understand images and tags.

Also, by clever use of manual actions and when: always, perhaps triggering manual actions could automatically cause reruns of subsequent (already run) jobs to pick up new changes generated by the manual action, such as a new Docker image.

Proposal

Links / references

/cc @grzesiek

Edited by 🤖 GitLab Bot 🤖