CI pipeline imports timing out on Gitlab Migration
When importing a larger project like https://staging.gitlab.com/gitlab-migration/gitlab-qa, ci pipeline import seems to always time out resulting in 0 imported pipelines.
{"feature_category":"importers","severity":"ERROR","time":"2022-06-19T08:55:59.878Z","correlation_id":"82e5184828426aad4d48dfcd4a26ee89","entity_id":2,"pipeline_name":"BulkImports::Projects::Pipelines::CiPipelinesPipeline","message":"Pipeline timeout","meta.user":"root","meta.client_id":"user/1","meta.caller_id":"BulkImports::PipelineWorker","meta.remote_ip":"172.18.0.3","meta.feature_category":"importers","meta.root_caller_id":"POST /api/:version/bulk_imports","class":"BulkImports::PipelineWorker","job_status":"running","queue":"bulk_imports_pipeline","jid":"290753acc1b1c1a7665196a3"}
{"feature_category":"importers","severity":"ERROR","time":"2022-06-19T08:55:59.897Z","correlation_id":"82e5184828426aad4d48dfcd4a26ee89","entity_id":2,"pipeline_name":"BulkImports::Projects::Pipelines::PipelineSchedulesPipeline","message":"Pipeline timeout","meta.user":"root","meta.client_id":"user/1","meta.caller_id":"BulkImports::PipelineWorker","meta.remote_ip":"172.18.0.3","meta.feature_category":"importers","meta.root_caller_id":"POST /api/:version/bulk_imports","class":"BulkImports::PipelineWorker","job_status":"running","queue":"bulk_imports_pipeline","jid":"951f54333f6333a272160b8d"}
{"feature_category":"importers","severity":"ERROR","time":"2022-06-19T08:55:59.901Z","correlation_id":"82e5184828426aad4d48dfcd4a26ee89","entity_id":2,"pipeline_name":"BulkImports::Projects::Pipelines::AutoDevopsPipeline","message":"Pipeline timeout","meta.user":"root","meta.client_id":"user/1","meta.caller_id":"BulkImports::PipelineWorker","meta.remote_ip":"172.18.0.3","meta.feature_category":"importers","meta.root_caller_id":"POST /api/:version/bulk_imports","class":"BulkImports::PipelineWorker","job_status":"running","queue":"bulk_imports_pipeline","jid":"46337c179a535b81c0cae30c"}
Note
We have opened other issues that should eventually fix this problem. We will continue working on these in the next milestones (15.7 onwards), in particular:
and
- GitLab Migration - export relations compressed ... (#379216)
- GitLab Migration - import relations compressed ... (#379219)
- GitLab Migration - export file metadata when ex... (#379222)
- After supporting compression with zip: read ind... (#379223)
coming out of POC Explore possibility of exporting a `.zip` file ... (#376261 - closed)
Edited by Magdalena Frankiewicz