Create model, table, and uploader for project-level package files

Background

Some package formats require the existance of files outside of the individual package. RPM yum/dnf repositories use a set of xml metadata files that live at the repository-level. For the GitLab package registry, this means the project-level.

Proposal

Similar to how we have Packages::PackageFiles for package files associated to a given Package, we need a new model to define package files that are associated with a project, or all packages of a certain type within that project.

1. Create a new model Packages::RepositoryPackageFiles with a matching table project_repository_package_files
2. Create a new uploader Packages::RepositoryPackageFileUploader. The dynamic_segment should be Gitlab::HashedPath.new('projects', model.project.id, 'package_repository_files', model.id, root_hash: model.project_id)

Implementation notes

• We need to include these files in the project statistics using update_project_statistics project_statistics_name: :packages_size
• These should be destroyed upon project deletion. We should be able to tie it in to the existing Packages::Destructible model so it is deleted async.

added to epic &5128

@10io, would you please review this proposal? I was hoping to keep it fairly simple in the first iteration. Enough to get files stored so we can focus on the metadata generation, but was curious if you had any preference between Packages::RepositoryPackageFiles, Packages::ProjectPackageFiles, Project::PackageFiles, or any other ideas.

I liked the idea of Packages::RepositoryPackageFiles because it allows us to extend it beyond the idea of projects if we ever want to. Although the dynamic segment on the uploader might tie us to the project so it might not matter.

changed milestone to %15.4

added Category:Package Registry RPM Repository [deprecated] Accepting merge requests backend devopspackage feature flag featureaddition grouppackage registry rails sectionops typefeature workflowready for development labels

added workflowrefinement label and removed workflowready for development label

removed [deprecated] Accepting merge requests label

marked this issue as blocking #371800 (closed)

mentioned in issue #296785 (closed)

assigned to @Mshab

mentioned in epic &5128

added workflowin dev label and removed workflowrefinement label

mentioned in commit d7e85b68

mentioned in merge request !97484 (merged)

mentioned in commit 56a46a6c

mentioned in commit 94436b4e

mentioned in commit 7dff3e07

mentioned in commit d0bdba20

mentioned in commit 6e252bf3

mentioned in commit d3d243e6

mentioned in commit 580c7182

added workflowin review label and removed workflowin dev label

mentioned in commit 6125c867

mentioned in commit 79e078cd

mentioned in commit 3598690e

mentioned in commit 12034a0e

mentioned in commit d76e3b09

created branch 372286-create-model-table-and-uploader-for-project-level-package-files to address this issue

mentioned in issue #374518 (closed)

mentioned in commit ff02bb53

mentioned in commit 6fd8c700

mentioned in commit 368fa771

changed milestone to %15.5

added missed:15.4 label

mentioned in commit 63d09316

mentioned in commit 7e8d85d9

mentioned in commit 848921bb

mentioned in commit a3fef1bc

mentioned in commit b248cbe8

mentioned in commit 55893b0a

mentioned in commit 1c091f3c

mentioned in commit 78654428

mentioned in commit 269fd10c

mentioned in commit 7904b80c

mentioned in commit bc184ce9

mentioned in commit 327e3977

mentioned in commit f392f35e

added workflowproduction label and removed workflowin review label

closed