Offline transfer - outline export source architecture
The offline transfer architecture design document does not have much detail on how a source instance can export files to ndjson files. The POST groups/:id/export_relations
and POST projects/:id/export_relations
endpoints will export all file-based relations for direct transfer, but there's no model on the source for tracking overall export process, so it's not very useful for UI implementation, or convenient for API users to know when the export is complete. This issue is to outline the process and the models needed to export relations for offline transfer on the source.
Unresolved related comments on the architecture design
-
Writing to one metadata file throughout the export process creates the potential for race conditions because relations files are created in parallel. This will need to be accounted for in some way: gitlab-com/content-sites/handbook!12056 (comment 2402132216)
Edited by 🤖 GitLab Bot 🤖