Reimplement upload tracking and purging based on the metadata database
Problem
Upload purging and tracking currently rely on filesystem metadata and as-is consumes a lot of memory and scales poorly.
It is also a blocker to begin the work on related to &9459, due to the reasons discussed here
Context
This issue is to investigate possible solutions for reimplement upload tracking and purging using the metadata database. The right timing to start thinking about this is by the end of the GitLab.com registry upgrade/migration (&5523 (closed)).
Edited by Suleimi Ahmed