import_registry stucks
### Summary
I'm trying to import project(4k commits & 1k merge requests) from one self-hosted gitlab to another.
After https://gitlab.com/gitlab-org/gitlab-ee/issues/5874 i disable
```
# Settings.cron_jobs['import_export_project_cleanup_worker'] ||= Settingslogic.new({})
# Settings.cron_jobs['import_export_project_cleanup_worker']['cron'] ||= '0 * * * *'
# Settings.cron_jobs['import_export_project_cleanup_worker']['job_class'] = 'ImportExportProjectCleanupWorker'
```
and
```
# Settings.cron_jobs['stuck_import_jobs_worker'] ||= Settingslogic.new({})
# Settings.cron_jobs['stuck_import_jobs_worker']['cron'] ||= '15 * * * *'
# Settings.cron_jobs['stuck_import_jobs_worker']['job_class'] = 'StuckImportJobsWorker'
```
In `gitlab.rb`:
```
gitlab_rails['env'] = {
'SIDEKIQ_MEMORY_KILLER_MAX_RSS' => '60000000'
}
```
### Steps to reproduce
Export big project and try to import to another instance.
### What is the current *bug* behavior?
Import stucks.
### What is the expected *correct* behavior?
Correct import.
### Relevant logs and/or screenshots
### Output of checks
Selfosted omnibus-gitlab-ce 11.4.0
#### Results of GitLab environment info
<details>
<summary>Expand for output related to GitLab environment info</summary>
<pre>
System information
System: RedHatEnterpriseServer 7.3
Current User: git
Using RVM: no
Ruby Version: 2.4.4p296
Gem Version: 2.7.6
Bundler Version:1.16.2
Rake Version: 12.3.1
Redis Version: 3.2.12
Git Version: 2.18.1
Sidekiq Version:5.2.1
Go Version: unknown
GitLab information
Version: 11.4.0
Revision: 6ebbd70
Directory: /opt/gitlab/embedded/service/gitlab-rails
DB Adapter: postgresql
URL: http://gitlab.services.my-company.ru
HTTP Clone URL: http://gitlab.services.my-company.ru/some-group/some-project.git
SSH Clone URL: git@gitlab.services.my-company.ru:some-group/some-project.git
Using LDAP: yes
Using Omniauth: yes
Omniauth Providers:
GitLab Shell
Version: 8.3.3
Repository storage paths:
- default: /var/opt/gitlab/git-data/repositories
Hooks: /opt/gitlab/embedded/service/gitlab-shell/hooks
Git: /opt/gitlab/embedded/bin/git
</pre>
</details>
#### Results of GitLab application Check
<details>
<summary>Expand for output related to the GitLab application check</summary>
<pre>
Checking GitLab Shell ...
GitLab Shell version >= 8.3.3 ? ... OK (8.3.3)
Repo base directory exists?
default... yes
Repo storage directories are symlinks?
default... no
Repo paths owned by git:root, or git:git?
default... yes
Repo paths access is drwxrws---?
default... yes
hooks directories in repos are links: ...
1/1 ... repository is empty
61/3 ... ok
8/5 ... ok
61/7 ... ok
63/8 ... ok
6/9 ... ok
6/10 ... ok
63/11 ... ok
6/12 ... ok
6/13 ... ok
6/14 ... ok
56/15 ... ok
55/17 ... ok
6/18 ... ok
56/19 ... ok
6/20 ... ok
6/21 ... ok
63/22 ... ok
6/23 ... ok
55/27 ... ok
6/28 ... ok
55/29 ... ok
5/32 ... ok
6/33 ... ok
6/35 ... ok
5/36 ... ok
6/37 ... ok
6/38 ... ok
15/40 ... ok
6/41 ... ok
175/42 ... ok
6/43 ... ok
15/44 ... ok
157/45 ... ok
15/46 ... ok
156/50 ... ok
157/52 ... ok
6/53 ... ok
157/54 ... ok
61/55 ... ok
61/56 ... ok
157/59 ... ok
175/60 ... ok
19/61 ... ok
6/62 ... ok
15/63 ... ok
15/73 ... ok
26/75 ... ok
10/76 ... ok
26/77 ... ok
25/79 ... ok
23/80 ... ok
23/82 ... ok
23/83 ... ok
23/84 ... ok
23/85 ... ok
23/86 ... ok
23/87 ... ok
23/88 ... ok
23/89 ... ok
23/90 ... ok
23/91 ... ok
23/92 ... ok
25/93 ... ok
26/95 ... ok
63/97 ... ok
25/98 ... ok
5/99 ... ok
63/101 ... ok
6/102 ... ok
19/104 ... ok
19/105 ... ok
19/109 ... ok
63/110 ... ok
6/112 ... ok
19/113 ... ok
157/114 ... ok
55/115 ... ok
63/116 ... ok
26/117 ... ok
24/118 ... ok
26/119 ... ok
5/120 ... ok
3/121 ... ok
163/122 ... ok
63/124 ... ok
15/125 ... ok
55/126 ... ok
15/127 ... ok
62/129 ... ok
19/131 ... ok
60/132 ... ok
19/133 ... ok
60/134 ... ok
62/135 ... ok
60/137 ... ok
23/138 ... ok
55/140 ... ok
55/141 ... repository is empty
61/142 ... ok
61/143 ... ok
61/144 ... ok
61/145 ... ok
61/146 ... ok
61/147 ... ok
61/148 ... ok
6/149 ... ok
75/151 ... ok
55/152 ... ok
60/155 ... repository is empty
6/156 ... repository is empty
63/159 ... ok
55/160 ... ok
185/161 ... ok
6/162 ... ok
6/165 ... repository is empty
97/169 ... ok
97/170 ... ok
90/171 ... ok
90/172 ... ok
63/177 ... ok
55/178 ... repository is empty
19/180 ... ok
25/182 ... ok
61/184 ... repository is empty
82/185 ... ok
62/187 ... ok
97/189 ... ok
15/190 ... ok
4/191 ... repository is empty
107/192 ... ok
97/195 ... ok
112/196 ... ok
6/197 ... ok
64/198 ... repository is empty
107/199 ... ok
62/200 ... ok
62/201 ... ok
112/202 ... ok
112/203 ... ok
112/204 ... ok
107/205 ... ok
107/206 ... ok
97/208 ... ok
60/209 ... ok
62/212 ... ok
6/215 ... ok
6/216 ... repository is empty
19/219 ... ok
55/220 ... ok
112/221 ... ok
97/223 ... ok
55/224 ... ok
112/225 ... ok
112/226 ... ok
112/227 ... ok
112/228 ... ok
112/229 ... ok
112/230 ... ok
107/231 ... ok
97/232 ... ok
55/233 ... repository is empty
107/237 ... ok
118/238 ... ok
157/239 ... ok
107/240 ... ok
19/242 ... ok
132/243 ... ok
107/244 ... ok
132/245 ... ok
132/246 ... ok
132/247 ... ok
132/248 ... ok
132/249 ... ok
132/250 ... ok
97/251 ... ok
19/252 ... repository is empty
63/253 ... ok
23/255 ... ok
23/256 ... ok
23/257 ... ok
23/258 ... ok
63/259 ... ok
23/260 ... ok
107/261 ... ok
23/262 ... ok
63/264 ... ok
55/265 ... repository is empty
55/266 ... repository is empty
6/267 ... ok
63/268 ... ok
15/269 ... ok
15/270 ... ok
14/271 ... repository is empty
106/272 ... ok
148/273 ... ok
157/274 ... ok
6/275 ... repository is empty
152/276 ... ok
37/277 ... ok
68/278 ... ok
61/279 ... ok
19/280 ... ok
19/281 ... ok
15/282 ... repository is empty
22/287 ... ok
61/288 ... ok
61/289 ... ok
61/290 ... ok
22/291 ... ok
62/292 ... ok
62/293 ... ok
163/295 ... ok
6/297 ... ok
25/299 ... ok
164/300 ... ok
61/301 ... ok
148/303 ... ok
15/304 ... ok
23/305 ... ok
8/306 ... ok
63/307 ... ok
6/308 ... ok
6/309 ... ok
15/313 ... ok
22/314 ... ok
148/316 ... ok
15/317 ... ok
18/318 ... repository is empty
61/319 ... repository is empty
152/320 ... repository is empty
152/321 ... ok
15/322 ... ok
172/323 ... ok
175/324 ... ok
175/325 ... ok
152/326 ... ok
75/327 ... ok
75/328 ... ok
75/329 ... ok
75/330 ... ok
75/331 ... ok
75/332 ... ok
19/334 ... ok
152/335 ... ok
152/336 ... ok
63/338 ... ok
62/340 ... ok
19/342 ... ok
62/343 ... ok
180/344 ... ok
152/345 ... ok
176/346 ... ok
176/347 ... ok
15/348 ... ok
15/349 ... ok
180/350 ... ok
3/351 ... ok
6/354 ... repository is empty
180/355 ... ok
152/356 ... ok
107/358 ... ok
184/359 ... ok
107/360 ... repository is empty
107/361 ... repository is empty
185/362 ... ok
19/363 ... repository is empty
6/364 ... ok
187/365 ... ok
187/366 ... ok
61/367 ... ok
187/369 ... ok
189/370 ... repository is empty
189/371 ... ok
189/372 ... ok
187/373 ... ok
189/377 ... ok
189/379 ... ok
189/380 ... ok
242/382 ... ok
189/383 ... ok
242/384 ... ok
186/385 ... ok
178/386 ... ok
206/387 ... ok
206/389 ... ok
19/390 ... repository is empty
221/391 ... ok
203/392 ... repository is empty
222/393 ... ok
221/394 ... ok
225/395 ... ok
3/396 ... ok
226/397 ... ok
227/398 ... ok
187/399 ... repository is empty
296/400 ... ok
226/402 ... repository is empty
294/403 ... ok
229/404 ... repository is empty
229/405 ... repository is empty
183/406 ... ok
189/409 ... ok
189/410 ... ok
189/411 ... ok
6/412 ... ok
294/414 ... ok
229/415 ... repository is empty
294/417 ... ok
187/418 ... ok
187/419 ... ok
180/420 ... ok
15/421 ... ok
180/423 ... ok
240/424 ... ok
235/425 ... ok
243/426 ... ok
243/427 ... ok
252/428 ... repository is empty
245/429 ... ok
295/431 ... ok
235/432 ... ok
252/433 ... ok
294/435 ... ok
294/436 ... ok
296/437 ... ok
263/438 ... repository is empty
251/439 ... repository is empty
26/440 ... ok
19/441 ... repository is empty
19/444 ... ok
226/445 ... ok
15/446 ... ok
309/447 ... repository is empty
295/448 ... ok
309/449 ... repository is empty
276/450 ... ok
276/451 ... repository is empty
252/453 ... ok
163/454 ... ok
294/456 ... ok
294/457 ... ok
294/458 ... repository is empty
309/461 ... repository is empty
309/462 ... repository is empty
294/463 ... ok
294/464 ... ok
294/465 ... ok
229/466 ... ok
316/467 ... ok
319/468 ... repository is empty
323/469 ... repository is empty
294/471 ... ok
19/472 ... repository is empty
295/473 ... ok
262/475 ... ok
294/476 ... ok
229/477 ... ok
19/482 ... ok
337/483 ... repository is empty
294/484 ... ok
295/485 ... ok
359/486 ... ok
295/487 ... ok
295/488 ... ok
294/489 ... ok
294/490 ... ok
193/494 ... ok
366/495 ... repository is empty
193/496 ... repository is empty
193/497 ... ok
193/498 ... ok
366/499 ... ok
193/500 ... ok
366/501 ... ok
193/502 ... ok
193/503 ... ok
193/504 ... ok
193/505 ... ok
193/506 ... ok
193/507 ... ok
193/508 ... repository is empty
193/509 ... ok
193/510 ... ok
193/511 ... ok
193/512 ... ok
193/513 ... ok
193/514 ... ok
193/515 ... ok
193/516 ... ok
193/517 ... ok
193/518 ... ok
193/519 ... ok
193/520 ... ok
220/521 ... ok
220/522 ... ok
193/523 ... ok
219/524 ... ok
219/525 ... ok
219/526 ... ok
77/527 ... ok
19/528 ... ok
Running /opt/gitlab/embedded/service/gitlab-shell/bin/check
Check GitLab API access: OK
Redis available via internal API: OK
Access to /var/opt/gitlab/.ssh/authorized_keys: OK
gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Sidekiq ...
Running? ... yes
Number of Sidekiq processes ... 1
Checking Sidekiq ... Finished
Reply by email is disabled in config/gitlab.yml
Checking LDAP ...
Server: ldapmain
LDAP authentication... Success
Checking LDAP ... Finished
Checking GitLab ...
Git configured correctly? ... yes
Database config exists? ... yes
All migrations up? ... yes
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config up to date? ... yes
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory exists? ... yes
Uploads directory has correct permissions? ... yes
Uploads directory tmp has correct permissions? ... no
Try fixing it:
sudo chown -R git /var/opt/gitlab/gitlab-rails/uploads
sudo find /var/opt/gitlab/gitlab-rails/uploads -type f -exec chmod 0644 {} \;
sudo find /var/opt/gitlab/gitlab-rails/uploads -type d -not -path /var/opt/gitlab/gitlab-rails/uploads -exec chmod 0700 {} \;
For more information see:
doc/install/installation.md in section "GitLab"
Please fix the error above and rerun the checks.
Init script exists? ... skipped (omnibus-gitlab has no init script)
Init script up-to-date? ... skipped (omnibus-gitlab has no init script)
Projects have namespace: ...
1/1 ... yes
61/3 ... yes
8/5 ... yes
61/7 ... yes
63/8 ... yes
6/9 ... yes
6/10 ... yes
63/11 ... yes
6/12 ... yes
6/13 ... yes
6/14 ... yes
56/15 ... yes
55/17 ... yes
6/18 ... yes
56/19 ... yes
6/20 ... yes
6/21 ... yes
63/22 ... yes
6/23 ... yes
55/27 ... yes
6/28 ... yes
55/29 ... yes
5/32 ... yes
6/33 ... yes
6/35 ... yes
5/36 ... yes
6/37 ... yes
6/38 ... yes
15/40 ... yes
6/41 ... yes
175/42 ... yes
6/43 ... yes
15/44 ... yes
157/45 ... yes
15/46 ... yes
156/50 ... yes
157/52 ... yes
6/53 ... yes
157/54 ... yes
61/55 ... yes
61/56 ... yes
157/59 ... yes
175/60 ... yes
19/61 ... yes
6/62 ... yes
15/63 ... yes
15/73 ... yes
26/75 ... yes
10/76 ... yes
26/77 ... yes
25/79 ... yes
23/80 ... yes
23/82 ... yes
23/83 ... yes
23/84 ... yes
23/85 ... yes
23/86 ... yes
23/87 ... yes
23/88 ... yes
23/89 ... yes
23/90 ... yes
23/91 ... yes
23/92 ... yes
25/93 ... yes
26/95 ... yes
63/97 ... yes
25/98 ... yes
5/99 ... yes
63/101 ... yes
6/102 ... yes
19/104 ... yes
19/105 ... yes
19/109 ... yes
63/110 ... yes
6/112 ... yes
19/113 ... yes
157/114 ... yes
55/115 ... yes
63/116 ... yes
26/117 ... yes
24/118 ... yes
26/119 ... yes
5/120 ... yes
3/121 ... yes
163/122 ... yes
63/124 ... yes
15/125 ... yes
55/126 ... yes
15/127 ... yes
62/129 ... yes
19/131 ... yes
60/132 ... yes
19/133 ... yes
60/134 ... yes
62/135 ... yes
60/137 ... yes
23/138 ... yes
55/140 ... yes
55/141 ... yes
61/142 ... yes
61/143 ... yes
61/144 ... yes
61/145 ... yes
61/146 ... yes
61/147 ... yes
61/148 ... yes
6/149 ... yes
75/151 ... yes
55/152 ... yes
60/155 ... yes
6/156 ... yes
63/159 ... yes
55/160 ... yes
185/161 ... yes
6/162 ... yes
6/165 ... yes
97/169 ... yes
97/170 ... yes
90/171 ... yes
90/172 ... yes
63/177 ... yes
55/178 ... yes
19/180 ... yes
25/182 ... yes
61/184 ... yes
82/185 ... yes
62/187 ... yes
97/189 ... yes
15/190 ... yes
4/191 ... yes
107/192 ... yes
97/195 ... yes
112/196 ... yes
6/197 ... yes
64/198 ... yes
107/199 ... yes
62/200 ... yes
62/201 ... yes
112/202 ... yes
112/203 ... yes
112/204 ... yes
107/205 ... yes
107/206 ... yes
97/208 ... yes
60/209 ... yes
62/212 ... yes
6/215 ... yes
6/216 ... yes
19/219 ... yes
55/220 ... yes
112/221 ... yes
97/223 ... yes
55/224 ... yes
112/225 ... yes
112/226 ... yes
112/227 ... yes
112/228 ... yes
112/229 ... yes
112/230 ... yes
107/231 ... yes
97/232 ... yes
55/233 ... yes
107/237 ... yes
118/238 ... yes
157/239 ... yes
107/240 ... yes
19/242 ... yes
132/243 ... yes
107/244 ... yes
132/245 ... yes
132/246 ... yes
132/247 ... yes
132/248 ... yes
132/249 ... yes
132/250 ... yes
97/251 ... yes
19/252 ... yes
63/253 ... yes
23/255 ... yes
23/256 ... yes
23/257 ... yes
23/258 ... yes
63/259 ... yes
23/260 ... yes
107/261 ... yes
23/262 ... yes
63/264 ... yes
55/265 ... yes
55/266 ... yes
6/267 ... yes
63/268 ... yes
15/269 ... yes
15/270 ... yes
14/271 ... yes
106/272 ... yes
148/273 ... yes
157/274 ... yes
6/275 ... yes
152/276 ... yes
37/277 ... yes
68/278 ... yes
61/279 ... yes
19/280 ... yes
19/281 ... yes
15/282 ... yes
22/287 ... yes
61/288 ... yes
61/289 ... yes
61/290 ... yes
22/291 ... yes
62/292 ... yes
62/293 ... yes
163/295 ... yes
6/297 ... yes
25/299 ... yes
164/300 ... yes
61/301 ... yes
148/303 ... yes
15/304 ... yes
23/305 ... yes
8/306 ... yes
63/307 ... yes
6/308 ... yes
6/309 ... yes
15/313 ... yes
22/314 ... yes
148/316 ... yes
15/317 ... yes
18/318 ... yes
61/319 ... yes
152/320 ... yes
152/321 ... yes
15/322 ... yes
172/323 ... yes
175/324 ... yes
175/325 ... yes
152/326 ... yes
75/327 ... yes
75/328 ... yes
75/329 ... yes
75/330 ... yes
75/331 ... yes
75/332 ... yes
19/334 ... yes
152/335 ... yes
152/336 ... yes
63/338 ... yes
62/340 ... yes
19/342 ... yes
62/343 ... yes
180/344 ... yes
152/345 ... yes
176/346 ... yes
176/347 ... yes
15/348 ... yes
15/349 ... yes
180/350 ... yes
3/351 ... yes
6/354 ... yes
180/355 ... yes
152/356 ... yes
107/358 ... yes
184/359 ... yes
107/360 ... yes
107/361 ... yes
185/362 ... yes
19/363 ... yes
6/364 ... yes
187/365 ... yes
187/366 ... yes
61/367 ... yes
187/369 ... yes
189/370 ... yes
189/371 ... yes
189/372 ... yes
187/373 ... yes
189/377 ... yes
189/379 ... yes
189/380 ... yes
242/382 ... yes
189/383 ... yes
242/384 ... yes
186/385 ... yes
178/386 ... yes
206/387 ... yes
206/389 ... yes
19/390 ... yes
221/391 ... yes
203/392 ... yes
222/393 ... yes
221/394 ... yes
225/395 ... yes
3/396 ... yes
226/397 ... yes
227/398 ... yes
187/399 ... yes
296/400 ... yes
226/402 ... yes
294/403 ... yes
229/404 ... yes
229/405 ... yes
183/406 ... yes
189/409 ... yes
189/410 ... yes
189/411 ... yes
6/412 ... yes
294/414 ... yes
229/415 ... yes
294/417 ... yes
187/418 ... yes
187/419 ... yes
180/420 ... yes
15/421 ... yes
180/423 ... yes
240/424 ... yes
235/425 ... yes
243/426 ... yes
243/427 ... yes
252/428 ... yes
245/429 ... yes
295/431 ... yes
235/432 ... yes
252/433 ... yes
294/435 ... yes
294/436 ... yes
296/437 ... yes
263/438 ... yes
251/439 ... yes
26/440 ... yes
19/441 ... yes
19/444 ... yes
226/445 ... yes
15/446 ... yes
309/447 ... yes
295/448 ... yes
309/449 ... yes
276/450 ... yes
276/451 ... yes
252/453 ... yes
163/454 ... yes
294/456 ... yes
294/457 ... yes
294/458 ... yes
309/461 ... yes
309/462 ... yes
294/463 ... yes
294/464 ... yes
294/465 ... yes
229/466 ... yes
316/467 ... yes
319/468 ... yes
323/469 ... yes
294/471 ... yes
19/472 ... yes
295/473 ... yes
262/475 ... yes
294/476 ... yes
229/477 ... yes
19/482 ... yes
337/483 ... yes
294/484 ... yes
295/485 ... yes
359/486 ... yes
295/487 ... yes
295/488 ... yes
294/489 ... yes
294/490 ... yes
193/494 ... yes
366/495 ... yes
193/496 ... yes
193/497 ... yes
193/498 ... yes
366/499 ... yes
193/500 ... yes
366/501 ... yes
193/502 ... yes
193/503 ... yes
193/504 ... yes
193/505 ... yes
193/506 ... yes
193/507 ... yes
193/508 ... yes
193/509 ... yes
193/510 ... yes
193/511 ... yes
193/512 ... yes
193/513 ... yes
193/514 ... yes
193/515 ... yes
193/516 ... yes
193/517 ... yes
193/518 ... yes
193/519 ... yes
193/520 ... yes
220/521 ... yes
220/522 ... yes
193/523 ... yes
219/524 ... yes
219/525 ... yes
219/526 ... yes
77/527 ... yes
19/528 ... yes
Redis version >= 2.8.0? ... yes
Ruby version >= 2.3.5 ? ... yes (2.4.4)
Git version >= 2.9.5 ? ... yes (2.18.1)
Git user has default SSH configuration? ... yes
Active users: ... 288
Checking GitLab ... Finished
</pre>
</details>
issue