Pipelines stuck in created state after retry

I noticed in !19189 (merged) that after hitting Retry on the pipeline, I see four jobs in this state: