Replace API with ZIP in the license-feeder EPSS flow
Description
The EPSS server has shown stability issues (for example: https://gitlab.com/gitlab-org/security-products/license-db/deployment/-/jobs/8816433127, &11544 (comment 2144490530)), causing frequent failures in our license-feeder
flow when making multiple API calls with increasing offsets. This also affects our unit tests, making them flaky.
These changes should improve the stability of the license-feeder EPSS flow, make the UT more reliable and reduce the risk of partial data updates.
Implementation Plan
-
Replace API with ZIP Download: -
Switch from making multiple API calls to downloading a single ZIP file, processing it and publishing data in batches. This will reduce failure probability by minimizing network requests. -
deploy changes -
Update EPSS ADR to reflect this change.
-
Edited by Orin Naaman