-j support for project import by manifest file
Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.
Problem to solve
Overloaded GitLab server when bulk importing big number of repositories via manifest file
Intended users
System administrators
Further details
When importing projects via manifest file for AOSP, it's noticed that all project importing tasks will be scheduled and use all available Sidekiq resources. This can lead to the system unresponsive due to overloading.
Proposal
The repo tool has an option -j to specify the level of parallelism when downloading source code from Git server. Can we do something similar so that user can control the parallelism of the importing to balance the efficiency and load in accordance with concurrency settings on Sidekiq. It would be better to even control the scheduling of the tasks in addition to actual running the importing as scheduling all together also consumes fairly high amount of resource.
The information of -j could be already included in manifest file via sync-j supported by repo.
Permissions and Security
Documentation
What does success look like, and how can we measure that?
When user clicks the button