Skip to content

Update importers to use application settings to limit number of jobs

Rodrigo Tomonari requested to merge rodrigo/add-concurrent-import-jobs-limit-settings into master

What does this MR do and why?

Related to: #439286 (closed)

I updated GitHub Importer, BitBucketCloud Importer, and BitBucketServer Importer to use an application setting to control the number of concurrent jobs executed per minute instead of using a hardcoded value.

Also, this removes the github_import_increased_concurrent_workers feature flag which was used to test the limit on GitHub Importer.

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Screenshots or screen recordings

Screenshots are required for UI changes, and strongly recommended for all other merge requests.

Before After
Screenshot_2024-03-04_at_15.25.21 Screenshot_2024-03-04_at_15.25.03

How to set up and validate locally

To test locally, trigger an import via the desired importer by going to + Project, Import Project, choose select the importer, provide the crendential, select a repository to import and wait for the import to finish.

  • For Bitbucket Cloud, the OAuth integration needs to be enabled. Follow the steps from this doc. After that, you can import a project from Bitbucket Cloud.

  • For the Bitbucket Server, you need a Bitbucket Data Center instance. You can install one via Docker. A license will be required. You can request a trial license here.

Edited by Rodrigo Tomonari

Merge request reports