Allow default zip metadata reader limit to be configurable Open

Overview

For CI artifacts that contain a lot of files (for example, 500K), uploading can fail with the following error message:

ERROR: Uploading artifacts as "archive" to coordinator... too large archive id=359476 responseStatus=413 Request Entity Too Large status=413 Request Entity Too Large token=64_8rjay

Solution

Currently we return a value of 100 MB when the the artifact size is under 1GB.

We should offer a setting where the user can set the default number of bytes to allocate.

Related:

• Allow default zip metadata reader limit to be c... (!141581 - merged)
• Allow metadata zip reader limit to be configur... (omnibus-gitlab!7410 - merged)