Skip to content
Snippets Groups Projects
Open Storage and limits management for Package
  • Storage and limits management for Package

  • Storage and limits management for Package

    Open Epic created by Alessio Caiazza

    Problem

    The GitLab Package stage offers several features that if left unchecked, can result in high storage costs. The Package Registry allows our customers to publish and share packages in a variety of formats. The Container Registry allows them to do the same with images and tags. And the Dependency Proxy allows them to proxy and cache images (and in the future) packages from external remote repositories.

    Although we give customers ways to remove the above items from storage, we don't do a good job of:

    • Accurately informing Admin how much storage is being used in any given moment
    • Offering default, common-sense limits to prevent abuse (accidental or intentional)
    • Offering a robust set of tools to manage net-new and existing content
    • Ability to prevent further storage from being consumed when over 100% utilization of their plan

    Proposal

    Help our customers to understand how much storage they are using and give them the tools to effectively and programmatically manage their storage usage.

    1. Investigate existing application limits
    2. Validate Package Registry storage measurements are accurate
    3. Add limits to restrict file uploads to their respective types
    4. Add configurable limits to the size of files that can be uploaded
    5. Develop new limits where required
    6. Evaluate performance of limits and iterate

    Acceptance criteria

    • Storage should be counted in project statistics and rendered in quota page
    • Storage measurements should be accurate (i.e. reduce when cleaned)
    • Tools must be available to manage net-new and existing content
    • Ability to prevent further storage from being consumed when over 100% utilization of the plan
    • Application limits for our code are documented
    • Implemented application limits for each area of our code
    • Metrics associated with limits (overruns, exceptions)

    Related projects


    Edited by Tim Rizzi

    Linked items 0

  • Link items together to show that they're related or that one is blocking others.

    Activity

    • All activity
    • Comments only
    • History only
    • Newest first
    • Oldest first