Skip to content

Use quarantine folder for checking new blobs

Jerry Seto requested to merge 393535-newblobs-only-using-quarantine-directory into master

What does this MR do and why?

  • Adds ListAllBlobs rpc call for file size checks
  • Removes AllowExistingOversizedBlobs because it is not performant
  • call ListAllBlobs using only quarantine folder to check for new blobs

How to set up and validate locally

Try some variations of things like:

  1. Create a new project
  2. Enable the global_file_size_check feature flag
  3. Try to push a file that is larger than 100 MB see that oversize file is logged. (e.g head -c 104857601 /dev/urandom > new_100_MB_plus_1_byte)
  4. See that the oversized blob is logged

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Related to #393535 (closed)

Edited by Jerry Seto

Merge request reports