Skip to content

Replace API with ZIP in the license-feeder EPSS flow

Description

The EPSS server has shown stability issues (for example: https://gitlab.com/gitlab-org/security-products/license-db/deployment/-/jobs/8816433127, &11544 (comment 2144490530)), causing frequent failures in our license-feeder flow when making multiple API calls with increasing offsets. This also affects our unit tests, making them flaky.

These changes should improve the stability of the license-feeder EPSS flow, make the UT more reliable and reduce the risk of partial data updates.

Implementation Plan

  • Replace API with ZIP Download:
    • Switch from making multiple API calls to downloading a single ZIP file, processing it and publishing data in batches. This will reduce failure probability by minimizing network requests.
    • deploy changes
    • Update EPSS ADR to reflect this change.
Edited by Orin Naaman