Skip to content

Update Gitlab::LicenseScanning::PackageLicenses#fetch to process components in batches

Proposal

While working on Add class for fetching package licenses (!107186 - merged), it was determined in this comment that fetching over 5,000 records at a time is too slow, and that it's more efficient to fetch in batches of 700 records. Due to time constraints, we decided to impose a maximum allowed value of 1,000 components for the fetch method, and to update the logic in a follow-up issue to handle an arbitrary number of components.

The purpose of this issue is to update the Gitlab::LicenseScanning::PackageLicenses#fetch method so it fetches in batches of 700 records, and is capable of handling an arbitrary number of components efficiently.