DB migration failing during the deployment from 14.1.2 to 14.2.2

Summary

Zendesk ticket : https://gitlab.zendesk.com/agent/tickets/236949 (Internal Only)

We found out that the schema of ci_build_needs table is not correct, column build_id should have the type "bigint" but it is still integer. Please find in below a comparison of the schema on production (bad state) and on staging (correct state).

[ON PRODUCTION]
gitlabrds=> \d+ ci_build_needs
                                                          Table "public.ci_build_needs"
           Column           |  Type   | Collation | Nullable |                  Default                   | Storage  | Stats target | Description
----------------------------+---------+-----------+----------+--------------------------------------------+----------+--------------+-------------
 id                         | integer |           | not null | nextval('ci_build_needs_id_seq'::regclass) | plain    |              |
 build_id                   | integer |           | not null |                                            | plain    |              |
 name                       | text    |           | not null |                                            | extended |              |
 artifacts                  | boolean |           | not null | true                                       | plain    |              |
 optional                   | boolean |           | not null | false                                      | plain    |              |
 build_id_convert_to_bigint | bigint  |           | not null | 0                                          | plain    |              |
Indexes:
    "ci_build_needs_pkey" PRIMARY KEY, btree (id)
    "index_ci_build_needs_on_build_id_and_name" UNIQUE, btree (build_id, name)
    "index_ci_build_needs_on_build_id_convert_to_bigint_and_name" UNIQUE, btree (build_id_convert_to_bigint, name) INVALID
Foreign-key constraints:
    "fk_rails_3cf221d4ed" FOREIGN KEY (build_id) REFERENCES ci_builds(id) ON DELETE CASCADE
    "fk_rails_3cf221d4ed_tmp" FOREIGN KEY (build_id_convert_to_bigint) REFERENCES ci_builds(id) ON DELETE CASCADE NOT VALID
Triggers:
    trigger_21e7a2602957 BEFORE INSERT OR UPDATE ON ci_build_needs FOR EACH ROW EXECUTE FUNCTION trigger_21e7a2602957()
Access method: heap

---
[ON STAGING]
gitlabrds=> \d+ ci_build_needs
                                                          Table "public.ci_build_needs"
           Column           |  Type   | Collation | Nullable |                  Default                   | Storage  | Stats target | Description
----------------------------+---------+-----------+----------+--------------------------------------------+----------+--------------+-------------
 id                         | integer |           | not null | nextval('ci_build_needs_id_seq'::regclass) | plain    |              |
 build_id_convert_to_bigint | integer |           | not null | 0                                          | plain    |              |
 name                       | text    |           | not null |                                            | extended |              |
 artifacts                  | boolean |           | not null | true                                       | plain    |              |
 optional                   | boolean |           | not null | false                                      | plain    |              |
 build_id                   | bigint  |           | not null |                                            | plain    |              |
Indexes:
    "ci_build_needs_pkey" PRIMARY KEY, btree (id)
    "index_ci_build_needs_on_build_id_and_name" UNIQUE, btree (build_id, name)
Foreign-key constraints:
    "fk_rails_3cf221d4ed" FOREIGN KEY (build_id) REFERENCES ci_builds(id) ON DELETE CASCADE
Triggers:
    trigger_21e7a2602957 BEFORE INSERT OR UPDATE ON ci_build_needs FOR EACH ROW EXECUTE FUNCTION trigger_21e7a2602957()
Access method: heap

We suspect this is due to the fact that the migration process has never been able to run step 20210714015537. Please find here a relevant commit e8e55132

gitlab-rake db:migrate:status | grep 20210701033622
down 20210701033622 Finalize ci builds needs bigint conversion

Error found when running db:migration

DETAIL: Key (build_id_convert_to_bigint)=(0) is not present in table "ci_builds".
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers.rb:292:in `block in add_concurrent_foreign_key'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers.rb:353:in `disable_statement_timeout'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers.rb:291:in `add_concurrent_foreign_key'
/opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20210701033622_finalize_ci_builds_needs_bigint_conversion.rb:32:in `swap'
/opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20210701033622_finalize_ci_builds_needs_bigint_conversion.rb:18:in `up'
/opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:61:in `block (3 levels) in <top (required)>'
/opt/gitlab/embedded/bin/bundle:23:in `load'
/opt/gitlab/embedded/bin/bundle:23:in `<main>'
Caused by:
ActiveRecord::InvalidForeignKey: PG::ForeignKeyViolation: ERROR: insert or update on table "ci_build_needs" violates foreign key constraint "fk_rails_3cf221d4ed_tmp"

At that time, we bypassed the issue with gitlab support by editing the file /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20210701033622_finalize_ci_builds_needs_bigint_conversion.rb and commenting out line 18, calling the swap function.

Steps to reproduce

Upgrade from Gitlab-ee 14.1.2 to 14.2.2

What is the current bug behavior?

What is the expected correct behavior?

Relevant logs and/or screenshots

Output of checks

Results of GitLab environment info

Expand for output related to GitLab environment info

System information
System:
Proxy:          no
Current User:   git
Using RVM:      no
Ruby Version:   2.7.2p137
Gem Version:    3.1.4
Bundler Version:2.1.4
Rake Version:   13.0.6
Redis Version:  6.0.14
Git Version:    2.32.0
Sidekiq Version:5.2.9
Go Version:     unknown

GitLab information
Version:        14.2.2-ee
Revision:       406469ced21
Directory:      /opt/gitlab/embedded/service/gitlab-rails
DB Adapter:     PostgreSQL
DB Version:     12.7
URL:            https://XXXX
HTTP Clone URL: https://XXXX/some-group/some-project.git
SSH Clone URL:  git@gitlab.XXX:some-group/some-project.git
Elasticsearch:  no
Geo:            no
Using LDAP:     no
Using Omniauth: yes
Omniauth Providers: saml

GitLab Shell
Version:        13.19.1
Repository storage paths:
- default:      /var/opt/gitlab/git-data/repositories
GitLab Shell path:              /opt/gitlab/embedded/service/gitlab-shell
Git:            /opt/gitlab/embedded/bin/git

Results of GitLab application Check

Expand for output related to the GitLab application check

Checking GitLab subtasks ...
Checking GitLab Shell ...
GitLab Shell: ... GitLab Shell version >= 13.19.1 ? ... OK (13.19.1)
Running /opt/gitlab/embedded/service/gitlab-shell/bin/check
Internal API available: OK
Redis available via internal API: OK
gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Gitaly ...
Gitaly: ... default ... OK
Checking Gitaly ... Finished
Checking Sidekiq ...
Sidekiq: ... Running? ... yes
Number of Sidekiq processes (cluster/worker) ... 1/1
Checking Sidekiq ... Finished
Checking Incoming Email ...
Incoming Email: ... Reply by email is disabled in config/gitlab.yml
Checking Incoming Email ... Finished
Checking LDAP ...
LDAP: ... LDAP is disabled in config/gitlab.yml
Checking LDAP ... Finished
Checking GitLab App ...
Git configured correctly? ... yes
Database config exists? ... yes
All migrations up? ... yes
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config up to date? ... yes
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory exists? ... yes
Uploads directory has correct permissions? ... yes
Uploads directory tmp has correct permissions? ... yes
Init script exists? ... skipped (omnibus-gitlab has no init script)
Init script up-to-date? ... skipped (omnibus-gitlab has no init script)
Projects have namespace: ...
8/10 ... yes
12/14 ... yes
13/15 ... yes
8/16 ... yes
19/17 ... yes
15/22 ... yes
26/23 ... yes
28/24 ... yes
29/25 ... yes
57/26 ... yes
27/28 ... yes
27/29 ... yes
16/30 ... yes
422/31 ... yes
58/32 ... yes
55/33 ... yes
56/34 ... yes
178/35 ... yes
136/36 ... yes
41/37 ... yes
68/38 ... yes
427/39 ... yes
65/40 ... yes
389/41 ... yes
20/42 ... yes
77/43 ... yes
40/45 ... yes
80/46 ... yes
41/47 ... yes
58/48 ... yes
3/49 ... yes
78/50 ... yes
62/51 ... yes
16/52 ... yes
98/53 ... yes
61/54 ... yes
55/55 ... yes
97/56 ... yes
26/57 ... yes
103/58 ... yes
103/59 ... yes
103/60 ... yes
106/61 ... yes
79/63 ... yes
79/64 ... yes
101/65 ... yes
28/66 ... yes
28/67 ... yes
112/68 ... yes
120/70 ... yes
62/71 ... yes
79/72 ... yes
79/73 ... yes
79/74 ... yes
89/75 ... yes
122/76 ... yes
120/77 ... yes
120/78 ... yes
48/79 ... yes
133/80 ... yes
136/81 ... yes
178/82 ... yes
140/83 ... yes
143/84 ... yes
113/85 ... yes
149/86 ... yes
136/87 ... yes
113/88 ... yes
122/89 ... yes
122/90 ... yes
150/91 ... yes
1/94 ... yes
113/96 ... yes
119/97 ... yes
178/98 ... yes
150/99 ... yes
122/101 ... yes
82/103 ... yes
82/104 ... yes
178/105 ... yes
82/106 ... yes
59/107 ... yes
59/108 ... yes
59/109 ... yes
58/110 ... yes
28/111 ... yes
28/113 ... yes
28/114 ... yes
119/115 ... yes
57/116 ... yes
173/117 ... yes
174/118 ... yes
179/119 ... yes
180/120 ... yes
180/121 ... yes
180/122 ... yes
180/123 ... yes
180/124 ... yes
180/125 ... yes
171/126 ... yes
178/127 ... yes
1/128 ... yes
89/129 ... yes
195/130 ... yes
204/131 ... yes
16/132 ... yes
16/133 ... yes
190/134 ... yes
190/135 ... yes
190/136 ... yes
190/137 ... yes
190/138 ... yes
16/139 ... yes
16/140 ... yes
16/141 ... yes
16/142 ... yes
16/143 ... yes
16/144 ... yes
16/145 ... yes
190/146 ... yes
189/147 ... yes
16/148 ... yes
16/149 ... yes
16/150 ... yes
16/151 ... yes
16/152 ... yes
189/153 ... yes
16/154 ... yes
16/155 ... yes
16/156 ... yes
16/157 ... yes
16/158 ... yes
190/159 ... yes
190/160 ... yes
16/161 ... yes
190/162 ... yes
16/163 ... yes
190/164 ... yes
190/165 ... yes
190/166 ... yes
190/167 ... yes
16/168 ... yes
190/169 ... yes
190/170 ... yes
195/171 ... yes
82/173 ... yes
178/174 ... yes
82/175 ... yes
178/176 ... yes
41/177 ... yes
82/178 ... yes
171/179 ... yes
171/180 ... yes
193/181 ... yes
8/182 ... yes
178/183 ... yes
62/184 ... yes
82/185 ... yes
136/186 ... yes
136/187 ... yes
204/188 ... yes
204/189 ... yes
62/190 ... yes
113/191 ... yes
203/192 ... yes
180/193 ... yes
16/194 ... yes
16/195 ... yes
16/196 ... yes
113/197 ... yes
97/198 ... yes
195/199 ... yes
221/201 ... yes
173/202 ... yes
222/203 ... yes
171/204 ... yes
180/206 ... yes
180/209 ... yes
180/210 ... yes
180/211 ... yes
223/212 ... yes
178/213 ... yes
195/214 ... yes
227/215 ... yes
227/216 ... yes
227/217 ... yes
227/218 ... yes
227/219 ... yes
227/220 ... yes
227/221 ... yes
227/222 ... yes
227/223 ... yes
227/224 ... yes
227/225 ... yes
227/226 ... yes
227/227 ... yes
227/228 ... yes
62/229 ... yes
119/230 ... yes
135/231 ... yes
107/232 ... yes
233/233 ... yes
232/234 ... yes
239/235 ... yes
178/237 ... yes
244/239 ... yes
178/240 ... yes
55/241 ... yes
204/242 ... yes
216/243 ... yes
180/244 ... yes
221/245 ... yes
97/246 ... yes
243/247 ... yes
79/248 ... yes
171/249 ... yes
497/250 ... yes
287/251 ... yes
287/252 ... yes
355/253 ... yes
244/254 ... yes
292/255 ... yes
149/256 ... yes
149/257 ... yes
149/258 ... yes
149/259 ... yes
293/260 ... yes
149/261 ... yes
149/262 ... yes
149/263 ... yes
149/264 ... yes
149/265 ... yes
149/266 ... yes
149/267 ... yes
292/268 ... yes
149/269 ... yes
149/270 ... yes
149/271 ... yes
292/272 ... yes
292/273 ... yes
292/274 ... yes
292/275 ... yes
292/276 ... yes
292/277 ... yes
292/278 ... yes
292/279 ... yes
292/280 ... yes
292/281 ... yes
292/282 ... yes
292/283 ... yes
296/284 ... yes
298/285 ... yes
292/286 ... yes
403/287 ... yes
114/288 ... yes
2/289 ... yes
239/290 ... yes
239/292 ... yes
113/294 ... yes
305/295 ... yes
310/296 ... yes
310/298 ... yes
325/299 ... yes
325/300 ... yes
321/301 ... yes
321/302 ... yes
35/303 ... yes
171/304 ... yes
306/306 ... yes
180/308 ... yes
77/309 ... yes
262/310 ... yes
62/311 ... yes
335/312 ... yes
168/313 ... yes
168/314 ... yes
1061/315 ... yes
340/316 ... yes
89/317 ... yes
341/318 ... yes
341/319 ... yes
341/320 ... yes
341/321 ... yes
21/322 ... yes
19/323 ... yes
65/324 ... yes
63/325 ... yes
387/326 ... yes
437/327 ... yes
63/328 ... yes
393/329 ... yes
65/330 ... yes
435/331 ... yes
390/332 ... yes
389/333 ... yes
388/334 ... yes
388/335 ... yes
63/336 ... yes
66/337 ... yes
66/338 ... yes
436/339 ... yes
388/340 ... yes
387/341 ... yes
66/342 ... yes
66/343 ... yes
66/344 ... yes
389/345 ... yes
392/346 ... yes
66/347 ... yes
65/348 ... yes
65/349 ... yes
388/350 ... yes
65/351 ... yes
65/352 ... yes
66/353 ... yes
66/354 ... yes
723/355 ... yes
392/356 ... yes
394/357 ... yes
67/358 ... yes
64/359 ... yes
391/360 ... yes
31/361 ... yes
354/362 ... yes
89/363 ... yes
301/364 ... yes
301/365 ... yes
89/366 ... yes
122/367 ... yes
363/368 ... yes
363/369 ... yes
16/370 ... yes
33/371 ... yes
364/372 ... yes
89/373 ... yes
287/374 ... yes
19/375 ... yes
63/377 ... yes
16/378 ... yes
370/379 ... yes
371/380 ... yes
370/381 ... yes
321/382 ... yes
325/383 ... yes
180/384 ... yes
180/385 ... yes
180/386 ... yes
180/387 ... yes
180/388 ... yes
180/390 ... yes
180/391 ... yes
180/392 ... yes
180/393 ... yes
180/394 ... yes
180/395 ... yes
180/396 ... yes
180/397 ... yes
180/398 ... yes
180/399 ... yes
180/400 ... yes
89/401 ... yes
380/402 ... yes
380/403 ... yes
509/404 ... yes
305/405 ... yes
305/406 ... yes
65/407 ... yes
355/408 ... yes
89/409 ... yes
403/410 ... yes
122/411 ... yes
397/412 ... yes
397/413 ... yes
1/414 ... yes
408/415 ... yes
363/416 ... yes
62/417 ... yes
109/418 ... yes
371/419 ... yes
361/420 ... yes
361/421 ... yes
370/422 ... yes
287/423 ... yes
287/424 ... yes
287/425 ... yes
415/426 ... yes
370/427 ... yes
370/428 ... yes
451/429 ... yes
416/430 ... yes
425/431 ... yes
370/432 ... yes
417/433 ... yes
372/434 ... yes
419/435 ... yes
417/436 ... yes
419/437 ... yes
419/438 ... yes
89/439 ... yes
422/440 ... yes
424/441 ... yes
287/442 ... yes
363/443 ... yes
363/444 ... yes
427/445 ... yes
63/446 ... yes
233/447 ... yes
403/448 ... yes
62/449 ... yes
443/450 ... yes
445/451 ... yes
122/452 ... yes
224/453 ... yes
403/454 ... yes
63/455 ... yes
63/456 ... yes
171/457 ... yes
562/459 ... yes
224/460 ... yes
459/461 ... yes
662/462 ... yes
479/464 ... yes
292/466 ... yes
425/470 ... yes
1/472 ... yes
475/473 ... yes
479/474 ... yes
101/475 ... yes
479/476 ... yes
16/477 ... yes
340/478 ... yes
58/479 ... yes
204/480 ... yes
204/481 ... yes
136/482 ... yes
82/483 ... yes
59/484 ... yes
58/485 ... yes
486/486 ... yes
178/487 ... yes
58/488 ... yes
482/489 ... yes
253/490 ... yes
496/491 ... yes
497/492 ... yes
416/493 ... yes
262/495 ... yes
263/496 ... yes
403/497 ... yes
263/498 ... yes
518/499 ... yes
517/500 ... yes
145/501 ... yes
145/502 ... yes
145/503 ... yes
145/504 ... yes
145/505 ... yes
145/506 ... yes
145/507 ... yes
115/509 ... yes
115/510 ... yes
521/511 ... yes
425/512 ... yes
425/513 ... yes
425/514 ... yes
425/515 ... yes
523/516 ... yes
425/517 ... yes
425/518 ... yes
425/519 ... yes
425/520 ... yes
403/521 ... yes
97/522 ... yes
425/523 ... yes
16/524 ... yes
16/525 ... yes
19/526 ... yes
19/527 ... yes
118/528 ... yes
46/529 ... yes
492/530 ... yes
516/531 ... yes
526/532 ... yes
537/535 ... yes
502/536 ... yes
31/537 ... yes
63/538 ... yes
511/539 ... yes
539/540 ... yes
16/541 ... yes
124/543 ... yes
540/544 ... yes
305/545 ... yes
16/547 ... yes
253/548 ... yes
253/549 ... yes
539/550 ... yes
552/552 ... yes
422/553 ... yes
553/554 ... yes
548/555 ... yes
122/556 ... yes
89/557 ... yes
566/558 ... yes
566/559 ... yes
471/560 ... yes
548/561 ... yes
548/562 ... yes
548/563 ... yes
89/564 ... yes
549/565 ... yes
549/566 ... yes
549/567 ... yes
549/568 ... yes
551/569 ... yes
551/570 ... yes
551/571 ... yes
550/572 ... yes
550/573 ... yes
550/574 ... yes
497/575 ... yes
1/576 ... yes
560/577 ... yes
560/578 ... yes
560/579 ... yes
560/580 ... yes
560/581 ... yes
560/582 ... yes
560/583 ... yes
560/584 ... yes
560/585 ... yes
560/586 ... yes
560/587 ... yes
560/588 ... yes
560/589 ... yes
560/590 ... yes
560/591 ... yes
560/592 ... yes
560/593 ... yes
560/594 ... yes
560/595 ... yes
560/596 ... yes
560/597 ... yes
560/598 ... yes
560/599 ... yes
560/600 ... yes
560/601 ... yes
560/602 ... yes
560/603 ... yes
556/604 ... yes
556/605 ... yes
556/606 ... yes
556/607 ... yes
556/608 ... yes
556/609 ... yes
556/610 ... yes
556/611 ... yes
556/612 ... yes
556/613 ... yes
556/614 ... yes
556/615 ... yes
556/616 ... yes
556/617 ... yes
556/618 ... yes
556/619 ... yes
556/620 ... yes
557/621 ... yes
557/622 ... yes
557/623 ... yes
557/624 ... yes
557/625 ... yes
557/626 ... yes
557/627 ... yes
557/628 ... yes
557/629 ... yes
537/630 ... yes
537/631 ... yes
537/632 ... yes
558/633 ... yes
558/634 ... yes
558/635 ... yes
558/636 ... yes
558/637 ... yes
558/638 ... yes
558/639 ... yes
558/640 ... yes
558/641 ... yes
558/642 ... yes
558/643 ... yes
558/644 ... yes
558/645 ... yes
558/646 ... yes
558/647 ... yes
558/648 ... yes
558/649 ... yes
558/650 ... yes
558/651 ... yes
558/652 ... yes
559/653 ... yes
559/654 ... yes
559/655 ... yes
559/656 ... yes
559/657 ... yes
559/658 ... yes
559/659 ... yes
559/660 ... yes
560/661 ... yes
492/662 ... yes
492/663 ... yes
591/664 ... yes
403/665 ... yes
419/666 ... yes
419/667 ... yes
598/668 ... yes
599/669 ... yes
601/670 ... yes
600/671 ... yes
59/672 ... yes
59/673 ... yes
1029/674 ... yes
540/675 ... yes
479/676 ... yes
464/677 ... yes
173/678 ... yes
7/679 ... yes
537/680 ... yes
597/681 ... yes
609/682 ... yes
380/683 ... yes
380/684 ... yes
611/685 ... yes
171/686 ... yes
548/687 ... yes
80/688 ... yes
266/689 ... yes
494/690 ... yes
614/691 ... yes
540/692 ... yes
548/693 ... yes
548/694 ... yes
548/695 ... yes
171/696 ... yes
62/697 ... yes
540/698 ... yes
517/699 ... yes
1043/700 ... yes
16/701 ... yes
103/702 ... yes
620/704 ... yes
620/705 ... yes
16/706 ... yes
523/707 ... yes
193/709 ... yes
540/710 ... yes
624/711 ... yes
625/712 ... yes
266/713 ... yes
627/714 ... yes
627/715 ... yes
627/716 ... yes
762/717 ... yes
357/718 ... yes
322/719 ... yes
629/720 ... yes
629/721 ... yes
629/722 ... yes
320/723 ... yes
631/724 ... yes
630/725 ... yes
323/726 ... yes
21/727 ... yes
323/728 ... yes
326/729 ... yes
326/730 ... yes
326/731 ... yes
321/732 ... yes
321/733 ... yes
115/734 ... yes
641/735 ... yes
599/736 ... yes
649/737 ... yes
649/738 ... yes
649/739 ... yes
649/740 ... yes
649/741 ... yes
647/742 ... yes
647/743 ... yes
647/744 ... yes
647/745 ... yes
324/746 ... yes
324/747 ... yes
324/748 ... yes
318/749 ... yes
318/750 ... yes
318/751 ... yes
318/752 ... yes
318/753 ... yes
318/754 ... yes
318/755 ... yes
318/756 ... yes
318/757 ... yes
318/758 ... yes
318/759 ... yes
318/760 ... yes
318/761 ... yes
318/762 ... yes
318/763 ... yes
318/764 ... yes
318/765 ... yes
318/766 ... yes
318/767 ... yes
318/768 ... yes
318/769 ... yes
318/770 ... yes
318/771 ... yes
662/772 ... yes
662/773 ... yes
16/774 ... yes
149/775 ... yes
666/776 ... yes
596/777 ... yes
380/778 ... yes
89/779 ... yes
424/780 ... yes
662/781 ... yes
641/782 ... yes
19/783 ... yes
597/784 ... yes
380/785 ... yes
380/786 ... yes
244/787 ... yes
689/788 ... yes
16/789 ... yes
204/790 ... yes
658/791 ... yes
124/792 ... yes
124/793 ... yes
658/794 ... yes
124/795 ... yes
124/796 ... yes
124/797 ... yes
124/798 ... yes
124/799 ... yes
658/800 ... yes
658/801 ... yes
658/802 ... yes
658/803 ... yes
658/804 ... yes
658/805 ... yes
658/806 ... yes
658/807 ... yes
658/808 ... yes
124/809 ... yes
492/810 ... yes
124/811 ... yes
124/812 ... yes
124/813 ... yes
658/814 ... yes
658/815 ... yes
591/816 ... yes
492/817 ... yes
658/818 ... yes
124/819 ... yes
124/820 ... yes
658/821 ... yes
658/822 ... yes
124/823 ... yes
482/824 ... yes
124/825 ... yes
124/826 ... yes
658/827 ... yes
124/828 ... yes
658/829 ... yes
658/830 ... yes
658/831 ... yes
124/832 ... yes
658/833 ... yes
124/834 ... yes
658/835 ... yes
124/836 ... yes
658/837 ... yes
658/838 ... yes
658/839 ... yes
124/840 ... yes
124/841 ... yes
658/842 ... yes
124/843 ... yes
658/844 ... yes
658/845 ... yes
658/846 ... yes
658/847 ... yes
658/848 ... yes
124/849 ... yes
124/850 ... yes
658/851 ... yes
492/852 ... yes
124/853 ... yes
658/854 ... yes
28/855 ... yes
697/856 ... yes
696/857 ... yes
260/858 ... yes
662/859 ... yes
57/860 ... yes
263/861 ... yes
424/862 ... yes
680/863 ... yes
598/864 ... yes
424/865 ... yes
696/866 ... yes
77/867 ... yes
77/868 ... yes
77/869 ... yes
424/870 ... yes
424/871 ... yes
714/872 ... yes
717/873 ... yes
715/874 ... yes
716/875 ... yes
722/876 ... yes
349/877 ... yes
12/878 ... yes
54/879 ... yes
548/880 ... yes
145/881 ... yes
145/882 ... yes
55/883 ... yes
292/884 ... yes
722/885 ... yes
731/886 ... yes
731/887 ... yes
287/888 ... yes
735/889 ... yes
239/890 ... yes
739/891 ... yes
741/892 ... yes
742/893 ... yes
180/894 ... yes
120/895 ... yes
120/896 ... yes
552/897 ... yes
12/898 ... yes
180/899 ... yes
665/900 ... yes
48/901 ... yes
552/904 ... yes
540/905 ... yes
762/906 ... yes
124/907 ... yes
106/908 ... yes
385/909 ... yes
55/910 ... yes
180/911 ... yes
769/912 ... yes
180/913 ... yes
767/914 ... yes
12/915 ... yes
764/917 ... yes
774/918 ... yes
180/919 ... yes
55/920 ... yes
1/921 ... yes
777/922 ... yes
262/923 ... yes
663/924 ... yes
779/925 ... yes
780/926 ... yes
780/927 ... yes
781/928 ... yes
783/929 ... yes
784/930 ... yes
785/931 ... yes
180/932 ... yes
443/933 ... yes
663/934 ... yes
663/935 ... yes
789/936 ... yes
775/937 ... yes
1260/938 ... yes
780/939 ... yes
779/940 ... yes
552/941 ... yes
136/942 ... yes
665/943 ... yes
665/944 ... yes
792/945 ... yes
792/946 ... yes
293/947 ... yes
293/948 ... yes
624/949 ... yes
560/950 ... yes
168/951 ... yes
566/952 ... yes
772/953 ... yes
220/954 ... yes
802/955 ... yes
773/956 ... yes
425/957 ... yes
443/958 ... yes
809/959 ... yes
810/960 ... yes
810/961 ... yes
811/962 ... yes
811/963 ... yes
82/964 ... yes
665/965 ... yes
59/966 ... yes
59/967 ... yes
59/968 ... yes
89/969 ... yes
828/970 ... yes
802/971 ... yes
802/972 ... yes
262/973 ... yes
582/974 ... yes
834/975 ... yes
665/976 ... yes
89/977 ... yes
178/978 ... yes
792/979 ... yes
736/980 ... yes
772/981 ... yes
772/982 ... yes
772/983 ... yes
772/984 ... yes
772/985 ... yes
772/986 ... yes
853/987 ... yes
62/988 ... yes
62/989 ... yes
773/990 ... yes
869/991 ... yes
869/992 ... yes
450/993 ... yes
872/994 ... yes
21/995 ... yes
872/996 ... yes
875/997 ... yes
557/998 ... yes
556/999 ... yes
558/1000 ... yes
559/1001 ... yes
560/1002 ... yes
562/1003 ... yes
588/1004 ... yes
663/1005 ... yes
311/1006 ... yes
875/1007 ... yes
879/1008 ... yes
869/1009 ... yes
552/1010 ... yes
552/1011 ... yes
552/1012 ... yes
552/1013 ... yes
552/1014 ... yes
802/1015 ... yes
887/1016 ... yes
963/1017 ... yes
964/1018 ... yes
204/1019 ... yes
870/1021 ... yes
425/1022 ... yes
965/1023 ... yes
966/1024 ... yes
895/1025 ... yes
967/1026 ... yes
890/1027 ... yes
968/1028 ... yes
809/1029 ... yes
809/1030 ... yes
899/1031 ... yes
902/1032 ... yes
905/1033 ... yes
905/1034 ... yes
12/1035 ... yes
76/1036 ... yes
76/1037 ... yes
76/1038 ... yes
1061/1041 ... yes
244/1042 ... yes
76/1043 ... yes
76/1044 ... yes
76/1045 ... yes
76/1046 ... yes
809/1047 ... yes
665/1048 ... yes
417/1049 ... yes
180/1050 ... yes
479/1051 ... yes
870/1052 ... yes
76/1053 ... yes
443/1054 ... yes
899/1055 ... yes
597/1056 ... yes
287/1057 ... yes
811/1058 ... yes
811/1059 ... yes
940/1060 ... yes
870/1061 ... yes
76/1062 ... yes
76/1063 ... yes
76/1064 ... yes
76/1065 ... yes
539/1067 ... yes
173/1068 ... yes
479/1069 ... yes
76/1070 ... yes
1030/1071 ... yes
953/1072 ... yes
220/1073 ... yes
76/1074 ... yes
76/1075 ... yes
76/1076 ... yes
1061/1078 ... yes
56/1079 ... yes
735/1080 ... yes
962/1084 ... yes
539/1085 ... yes
424/1086 ... yes
809/1087 ... yes
963/1088 ... yes
59/1089 ... yes
969/1090 ... yes
969/1091 ... yes
969/1092 ... yes
970/1093 ... yes
89/1094 ... yes
310/1095 ... yes
318/1096 ... yes
318/1097 ... yes
59/1098 ... yes
963/1099 ... yes
963/1100 ... yes
966/1101 ... yes
939/1102 ... yes
322/1103 ... yes
322/1104 ... yes
1026/1105 ... yes
1026/1106 ... yes
145/1107 ... yes
145/1108 ... yes
145/1109 ... yes
975/1115 ... yes
980/1116 ... yes
287/1118 ... yes
244/1126 ... yes
244/1127 ... yes
497/1128 ... yes
76/1129 ... yes
76/1130 ... yes
76/1131 ... yes
479/1132 ... yes
479/1133 ... yes
479/1134 ... yes
986/1135 ... yes
823/1136 ... yes
823/1137 ... yes
823/1138 ... yes
823/1139 ... yes
823/1140 ... yes
822/1141 ... yes
823/1142 ... yes
822/1143 ... yes
823/1144 ... yes
822/1145 ... yes
823/1146 ... yes
823/1147 ... yes
823/1148 ... yes
822/1149 ... yes
823/1150 ... yes
822/1151 ... yes
822/1152 ... yes
822/1153 ... yes
822/1154 ... yes
822/1155 ... yes
822/1156 ... yes
822/1157 ... yes
115/1158 ... yes
202/1159 ... yes
492/1160 ... yes
790/1161 ... yes
492/1162 ... yes
993/1163 ... yes
881/1164 ... yes
999/1165 ... yes
1001/1166 ... yes
1002/1167 ... yes
1002/1168 ... yes
1002/1169 ... yes
1002/1170 ... yes
1002/1171 ... yes
1002/1172 ... yes
479/1173 ... yes
479/1174 ... yes
479/1175 ... yes
479/1176 ... yes
479/1177 ... yes
479/1178 ... yes
1002/1179 ... yes
1002/1180 ... yes
1002/1181 ... yes
1002/1182 ... yes
1002/1183 ... yes
1002/1184 ... yes
1002/1185 ... yes
1002/1186 ... yes
292/1187 ... yes
1002/1188 ... yes
1002/1189 ... yes
1002/1190 ... yes
1002/1191 ... yes
292/1192 ... yes
1002/1193 ... yes
244/1194 ... yes
262/1195 ... yes
1008/1196 ... yes
1008/1197 ... yes
1008/1198 ... yes
1008/1199 ... yes
419/1200 ... yes
244/1201 ... yes
419/1202 ... yes
809/1203 ... yes
1012/1204 ... yes
999/1205 ... yes
999/1206 ... yes
999/1207 ... yes
999/1208 ... yes
999/1209 ... yes
999/1210 ... yes
560/1211 ... yes
895/1212 ... yes
1021/1213 ... yes
1021/1214 ... yes
1021/1215 ... yes
895/1216 ... yes
1024/1217 ... yes
1008/1218 ... yes
790/1219 ... yes
492/1220 ... yes
492/1221 ... yes
1027/1222 ... yes
479/1223 ... yes
263/1224 ... yes
597/1225 ... yes
999/1226 ... yes
905/1227 ... yes
1554/1228 ... yes
1043/1229 ... yes
1044/1230 ... yes
76/1231 ... yes
560/1232 ... yes
493/1233 ... yes
516/1234 ... yes
959/1235 ... yes
977/1236 ... yes
479/1237 ... yes
769/1238 ... yes
151/1239 ... yes
977/1240 ... yes
479/1241 ... yes
982/1242 ... yes
641/1243 ... yes
905/1244 ... yes
539/1245 ... yes
57/1246 ... yes
1129/1247 ... yes
865/1248 ... yes
1001/1249 ... yes
1061/1250 ... yes
494/1252 ... yes
905/1253 ... yes
1001/1254 ... yes
1115/1255 ... yes
56/1256 ... yes
1130/1257 ... yes
56/1258 ... yes
56/1259 ... yes
157/1260 ... yes
1141/1261 ... yes
1141/1262 ... yes
1141/1263 ... yes
1141/1264 ... yes
1141/1265 ... yes
1140/1266 ... yes
1135/1267 ... yes
1135/1268 ... yes
1128/1269 ... yes
1128/1270 ... yes
1128/1271 ... yes
1122/1272 ... yes
1122/1273 ... yes
1122/1274 ... yes
1122/1275 ... yes
1122/1276 ... yes
1122/1277 ... yes
1121/1278 ... yes
1121/1279 ... yes
1121/1280 ... yes
1121/1281 ... yes
1115/1282 ... yes
1115/1283 ... yes
1001/1284 ... yes
1001/1285 ... yes
1150/1286 ... yes
662/1287 ... yes
224/1288 ... yes
224/1289 ... yes
1160/1290 ... yes
545/1291 ... yes
64/1292 ... yes
479/1293 ... yes
1174/1294 ... yes
887/1295 ... yes
1175/1296 ... yes
1175/1297 ... yes
1176/1298 ... yes
887/1299 ... yes
1183/1301 ... yes
614/1302 ... yes
1184/1303 ... yes
226/1304 ... yes
244/1305 ... yes
1027/1306 ... yes
244/1307 ... yes
224/1308 ... yes
224/1309 ... yes
224/1310 ... yes
224/1311 ... yes
224/1312 ... yes
224/1313 ... yes
224/1314 ... yes
224/1315 ... yes
224/1316 ... yes
224/1317 ... yes
224/1318 ... yes
224/1319 ... yes
224/1320 ... yes
224/1321 ... yes
1189/1322 ... yes
597/1323 ... yes
178/1324 ... yes
55/1325 ... yes
893/1326 ... yes
1201/1327 ... yes
1202/1328 ... yes
419/1329 ... yes
802/1330 ... yes
1202/1331 ... yes
1207/1332 ... yes
1207/1333 ... yes
1159/1334 ... yes
1078/1335 ... yes
1210/1336 ... yes
1002/1337 ... yes
1002/1338 ... yes
1002/1339 ... yes
1002/1340 ... yes
1002/1341 ... yes
1002/1342 ... yes
1002/1343 ... yes
1002/1344 ... yes
1002/1345 ... yes
1002/1346 ... yes
1002/1347 ... yes
1002/1348 ... yes
1002/1349 ... yes
1002/1350 ... yes
1002/1351 ... yes
1002/1352 ... yes
1002/1353 ... yes
1002/1354 ... yes
1002/1355 ... yes
157/1356 ... yes
157/1357 ... yes
157/1358 ... yes
157/1359 ... yes
157/1360 ... yes
1068/1361 ... yes
1068/1362 ... yes
1068/1363 ... yes
1068/1364 ... yes
1068/1365 ... yes
1068/1366 ... yes
1068/1367 ... yes
1068/1368 ... yes
1068/1369 ... yes
1068/1370 ... yes
1068/1371 ... yes
1068/1372 ... yes
1068/1373 ... yes
1068/1374 ... yes
1068/1375 ... yes
1202/1376 ... yes
1202/1377 ... yes
1202/1378 ... yes
1202/1379 ... yes
1202/1380 ... yes
1202/1381 ... yes
1202/1382 ... yes
1202/1383 ... yes
1202/1384 ... yes
1202/1385 ... yes
1229/1386 ... yes
1195/1387 ... yes
1230/1388 ... yes
479/1389 ... yes
1229/1390 ... yes
530/1391 ... yes
479/1392 ... yes
1246/1394 ... yes
1068/1395 ... yes
552/1396 ... yes
1251/1397 ... yes
1048/1398 ... yes
244/1399 ... yes
1248/1400 ... yes
1248/1401 ... yes
385/1402 ... yes
869/1403 ... yes
812/1404 ... yes
1159/1405 ... yes
1159/1406 ... yes
1159/1407 ... yes
1258/1408 ... yes
1258/1409 ... yes
497/1410 ... yes
28/1411 ... yes
809/1412 ... yes
443/1413 ... yes
865/1414 ... yes
809/1415 ... yes
809/1416 ... yes
665/1417 ... yes
806/1418 ... yes
812/1419 ... yes
1002/1420 ... yes
762/1421 ... yes
145/1422 ... yes
1241/1423 ... yes
1241/1424 ... yes
1241/1425 ... yes
180/1427 ... yes
89/1428 ... yes
1305/1429 ... yes
262/1431 ... yes
1311/1432 ... yes
762/1433 ... yes
1182/1434 ... yes
124/1435 ... yes
224/1436 ... yes
1068/1437 ... yes
1315/1438 ... yes
1315/1439 ... yes
8/1440 ... yes
1159/1441 ... yes
57/1442 ... yes
1070/1443 ... yes
1328/1444 ... yes
1328/1445 ... yes
1068/1446 ... yes
101/1447 ... yes
1241/1448 ... yes
1241/1449 ... yes
1241/1450 ... yes
1241/1451 ... yes
494/1452 ... yes
262/1453 ... yes
1337/1466 ... yes
665/1467 ... yes
1241/1468 ... yes
1241/1469 ... yes
1241/1470 ... yes
1334/1471 ... yes
1182/1472 ... yes
809/1473 ... yes
1233/1474 ... yes
792/1475 ... yes
1203/1476 ... yes
1343/1477 ... yes
1323/1478 ... yes
1027/1479 ... yes
1312/1480 ... yes
380/1481 ... yes
27/1483 ... yes
1203/1484 ... yes
1202/1485 ... yes
1352/1487 ... yes
905/1488 ... yes
224/1489 ... yes
224/1490 ... yes
762/1491 ... yes
1338/1492 ... yes
1364/1493 ... yes
1027/1494 ... yes
224/1495 ... yes
980/1496 ... yes
263/1497 ... yes
1155/1498 ... yes
979/1499 ... yes
1374/1500 ... yes
1374/1501 ... yes
494/1502 ... yes
1308/1503 ... yes
178/1504 ... yes
977/1507 ... yes
921/1508 ... yes
432/1509 ... yes
1355/1510 ... yes
1355/1511 ... yes
1398/1512 ... yes
1399/1513 ... yes
1399/1514 ... yes
905/1515 ... yes
244/1516 ... yes
552/1517 ... yes
552/1518 ... yes
1404/1519 ... yes
1404/1520 ... yes
1404/1521 ... yes
1404/1522 ... yes
1404/1523 ... yes
870/1524 ... yes
432/1525 ... yes
35/1526 ... yes
1159/1527 ... yes
1068/1528 ... yes
1415/1529 ... yes
1416/1530 ... yes
1416/1531 ... yes
260/1532 ... yes
403/1533 ... yes
260/1534 ... yes
263/1535 ... yes
263/1536 ... yes
262/1537 ... yes
262/1538 ... yes
1214/1539 ... yes
25/1540 ... yes
1422/1541 ... yes
1422/1542 ... yes
1348/1543 ... yes
1399/1544 ... yes
1328/1545 ... yes
1428/1546 ... yes
380/1547 ... yes
35/1549 ... yes
1399/1550 ... yes
124/1551 ... yes
1439/1552 ... yes
93/1553 ... yes
76/1554 ... yes
1428/1555 ... yes
1428/1556 ... yes
999/1557 ... yes
1433/1558 ... yes
810/1559 ... yes
1453/1562 ... yes
1453/1563 ... yes
1453/1564 ... yes
1453/1565 ... yes
1453/1566 ... yes
1453/1567 ... yes
1453/1568 ... yes
1453/1569 ... yes
1453/1570 ... yes
1453/1571 ... yes
1453/1572 ... yes
1453/1573 ... yes
1453/1574 ... yes
1453/1575 ... yes
1454/1576 ... yes
1454/1577 ... yes
1454/1578 ... yes
1454/1579 ... yes
1454/1580 ... yes
1453/1581 ... yes
1453/1582 ... yes
1453/1583 ... yes
1453/1584 ... yes
1453/1585 ... yes
1453/1586 ... yes
1453/1587 ... yes
1453/1588 ... yes
1453/1589 ... yes
1453/1590 ... yes
1453/1591 ... yes
1453/1592 ... yes
1453/1593 ... yes
1453/1594 ... yes
1457/1595 ... yes
1451/1596 ... yes
1451/1597 ... yes
1433/1598 ... yes
1424/1599 ... yes
1433/1600 ... yes
1399/1601 ... yes
1433/1602 ... yes
1400/1603 ... yes
1400/1604 ... yes
1464/1605 ... yes
1061/1606 ... yes
1399/1608 ... yes
1469/1609 ... yes
1469/1610 ... yes
1023/1611 ... yes
1480/1612 ... yes
27/1613 ... yes
419/1614 ... yes
168/1615 ... yes
539/1616 ... yes
999/1617 ... yes
1399/1618 ... yes
1471/1620 ... yes
380/1621 ... yes
27/1622 ... yes
149/1623 ... yes
149/1624 ... yes
1028/1625 ... yes
1182/1626 ... yes
1178/1627 ... yes
1276/1628 ... yes
1460/1629 ... yes
1506/1630 ... yes
1468/1631 ... yes
1289/1632 ... yes
1495/1633 ... yes
999/1634 ... yes
1510/1635 ... yes
1498/1636 ... yes
1498/1638 ... yes
1265/1639 ... yes
1506/1640 ... yes
1458/1641 ... yes
1520/1642 ... yes
1514/1643 ... yes
1260/1644 ... yes
1520/1645 ... yes
62/1646 ... yes
1520/1647 ... yes
1520/1648 ... yes
1520/1649 ... yes
1520/1650 ... yes
1520/1651 ... yes
1520/1652 ... yes
1520/1653 ... yes
1520/1654 ... yes
1520/1655 ... yes
1520/1656 ... yes
1459/1657 ... yes
157/1658 ... yes
1531/1659 ... yes
1514/1660 ... yes
1541/1661 ... yes
1498/1662 ... yes
658/1663 ... yes
658/1664 ... yes
1537/1665 ... yes
1514/1666 ... yes
1068/1667 ... yes
1159/1669 ... yes
1539/1670 ... yes
1514/1671 ... yes
1542/1672 ... yes
494/1673 ... yes
1506/1674 ... yes
1506/1675 ... yes
1506/1676 ... yes
812/1677 ... yes
385/1678 ... yes
1526/1679 ... yes
1520/1680 ... yes
1520/1681 ... yes
1364/1682 ... yes
1195/1683 ... yes
1256/1684 ... yes
30/1685 ... yes
296/1686 ... yes
1521/1687 ... yes
905/1688 ... yes
1537/1689 ... yes
1433/1690 ... yes
1433/1691 ... yes
1694/1692 ... yes
1492/1694 ... yes
1492/1695 ... yes
289/1700 ... yes
244/1705 ... yes
1492/1708 ... yes
1492/1709 ... yes
1492/1710 ... yes
1492/1711 ... yes
1492/1712 ... yes
1492/1713 ... yes
1492/1714 ... yes
1492/1715 ... yes
1492/1716 ... yes
1492/1717 ... yes
1492/1718 ... yes
1492/1719 ... yes
1492/1720 ... yes
1492/1721 ... yes
1492/1722 ... yes
1492/1723 ... yes
1492/1724 ... yes
1492/1725 ... yes
1492/1726 ... yes
1492/1727 ... yes
1492/1728 ... yes
1492/1729 ... yes
1492/1730 ... yes
1492/1731 ... yes
1492/1732 ... yes
1492/1733 ... yes
1492/1734 ... yes
1492/1735 ... yes
1492/1736 ... yes
1492/1737 ... yes
1492/1738 ... yes
1492/1739 ... yes
1492/1740 ... yes
1492/1741 ... yes
1492/1742 ... yes
1492/1743 ... yes
1492/1744 ... yes
1492/1745 ... yes
1492/1746 ... yes
1492/1747 ... yes
1492/1748 ... yes
1521/1750 ... yes
516/1751 ... yes
1399/1752 ... yes
792/1753 ... yes
419/1754 ... yes
419/1755 ... yes
1469/1756 ... yes
1537/1757 ... yes
1469/1759 ... yes
869/1760 ... yes
1531/1761 ... yes
1582/1762 ... yes
1469/1763 ... yes
1595/1764 ... yes
1328/1765 ... yes
647/1766 ... yes
1531/1767 ... yes
1502/1768 ... yes
1610/1769 ... yes
1581/1770 ... yes
1599/1771 ... yes
1617/1772 ... yes
1248/1773 ... yes
1541/1774 ... yes
180/1775 ... yes
1541/1776 ... yes
1256/1781 ... yes
1256/1782 ... yes
1256/1783 ... yes
1627/1784 ... yes
494/1785 ... yes
1627/1786 ... yes
1444/1787 ... yes
921/1788 ... yes
63/1790 ... yes
1630/1791 ... yes
1630/1792 ... yes
1630/1793 ... yes
954/1794 ... yes
54/1795 ... yes
1506/1796 ... yes
1647/1797 ... yes
1647/1798 ... yes
1647/1799 ... yes
494/1800 ... yes
322/1801 ... yes
1469/1802 ... yes
55/1804 ... yes
492/1805 ... yes
1547/1806 ... yes
1129/1807 ... yes
1129/1808 ... yes
1129/1809 ... yes
1129/1810 ... yes
1129/1811 ... yes
1129/1812 ... yes
1699/1813 ... yes
1068/1814 ... yes
905/1815 ... yes
1678/1816 ... yes
1680/1817 ... yes
516/1818 ... yes
1621/1821 ... yes
1430/1822 ... yes
1621/1823 ... yes
1621/1824 ... yes
1621/1825 ... yes
1621/1826 ... yes
1621/1827 ... yes
1621/1828 ... yes
1621/1829 ... yes
1621/1830 ... yes
1621/1831 ... yes
1621/1832 ... yes
1621/1833 ... yes
89/1834 ... yes
1621/1835 ... yes
1621/1836 ... yes
1129/1837 ... yes
1627/1838 ... yes
1621/1839 ... yes
518/1840 ... yes
1627/1841 ... yes
1692/1842 ... yes
1692/1843 ... yes
1246/1844 ... yes
1246/1845 ... yes
1697/1846 ... yes
1289/1847 ... yes
1598/1848 ... yes
1699/1849 ... yes
244/1850 ... yes
1244/1851 ... yes
1260/1852 ... yes
1694/1853 ... yes
380/1854 ... yes
722/1855 ... yes
46/1856 ... yes
792/1857 ... yes
1627/1858 ... yes
1583/1859 ... yes
1746/1860 ... yes
1718/1861 ... yes
1159/1862 ... yes
890/1863 ... yes
385/1864 ... yes
1383/1865 ... yes
1723/1866 ... yes
465/1867 ... yes
1648/1868 ... yes
1627/1869 ... yes
1729/1870 ... yes
417/1871 ... yes
263/1872 ... yes
552/1873 ... yes
Redis version >= 5.0.0? ... yes
Ruby version >= 2.7.2 ? ... yes (2.7.2)
Git version >= 2.31.0 ? ... yes (2.32.0)
Git user has default SSH configuration? ... yes
Active users: ... 883
Is authorized keys file accessible? ... yes
GitLab configured to store new projects in hashed storage? ... yes
All projects are in hashed storage? ... yes
Elasticsearch version 7.x (6.4 - 6.x deprecated to be removed in 13.8)? ... skipped (elasticsearch is disabled)
Checking GitLab App ... Finished
Checking GitLab subtasks ... Finished

Possible fixes