Create offline transfer pipeline for BulkImports::Projects::Pipelines::RepositoryBundlePipeline
Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.
As part of leveraging our existing direct transfer service for offline transfers, we will need to add new file-based pipelines for pipelines in direct transfer that make API requests to the source instance during any part of the ETL pipeline. This new pipeline should not replace the existing pipeline and it should only be executed during offline transfer.
This issue is to create a pipeline compatible with offline transfer for BulkImports::Projects::Pipelines::RepositoryBundlePipeline
. Repository bundle relations are already exported in a file. However, this pipeline doesn't use the shared NDJSON extractor. Instead, this class implements its own extract
to fetch the exported repository bundle file. The new offline transfer transfer needs to do the same extraction from the configured object storage location instead of the source instance.