Add exponential backoff to execute stage retries
What does this MR do?
Adds exponential backoff when executing stage retries.
We may want to discuss the best min/max delay durations.
Why was this MR needed?
All stage retries can benefit from a little delay.
What's the best way to test this MR?
Will add tests shortly.