<!--IssueSummary start--> <details> <summary> Everyone can contribute. [Help move this issue forward](https://handbook.gitlab.com/handbook/marketing/developer-relations/contributor-success/community-contributors-workflows/#contributor-links) while earning points, leveling up and collecting rewards. </summary> - [Close this issue](https://contributors.gitlab.com/manage-issue?action=close&projectId=278964&issueIid=343444) </details> <!--IssueSummary end--> ## The problem Some pipelines might be too time and memory consuming. Imagine a pipeline that batch loads multiple snippets, then for each snippet we clone their repository. If a project has thousands of snippets, this might mean thousands of requests to clone repos and a very long time that this job would be taking from one of the Sidekiq job workers, basically taking this worker all for itself. ## The proposal Work on the pipelines so that we can make them splittable through Sidekiq workers. This will guarantee a better distribution of the Sidekiq workers and will also allow pipelines to be executed faster, as they'll be parallelized. /cc @acook.gitlab @georgekoltsov @hdelalic @kassio @dstull