Allow default zip metadata reader limit to be configurable Open
Overview
For CI artifacts that contain a lot of files (for example, 500K), uploading can fail with the following error message:
ERROR: Uploading artifacts as "archive" to coordinator... too large archive id=359476 responseStatus=413 Request Entity Too Large status=413 Request Entity Too Large token=64_8rjay
Solution
Currently we return a value of 100 MB
when the the artifact size is under 1GB.
We should offer a setting where the user can set the default number of bytes to allocate.
Related:
Edited by Ash McKenzie