`git pull` or `git clone` fails with `received signal`
gitlab(master)$ g pull -vv
Server supports multi_ack_detailed
Server supports side-band-64k
Server supports ofs-delta
Server version is git/2.7.4
Marking da246355cfba388fe454c1f0c6af61f6c80e43eb as complete
want 07f60c18df6305b3be645556481fcbc094f902b8 (refs/heads/15356-filters-should-change-issue-counts)
want 1f966182f3367118b6681f6b2ff5400743043cd3 (refs/heads/22271-drone-tag-pipeline-build)
want acc085c442e75f842f3e45ed52eec5c51640acf3 (refs/heads/22592-can-set-due-date-through-slash-commands-even-though-i-m-not-authorized-to)
want 45514dbbeca9bba9d07c52492a3b4696f3ee8318 (refs/heads/be-nice-to-docker-client)
want 9f2b7e992b9e8c2bcf96d629c5000a3d02f38a16 (refs/heads/better-lfs-ssh-tests)
want 570f3c56e6ee81e7afd982a92a6451cafaebe6c7 (refs/heads/feature/group-level-labels)
want 4977a167c020d85c0c41cd33f8c46b9ce61a6c38 (refs/heads/fix-csfr-typo-in-doc)
want 912e9bae245ed002c98f9d02961b2a3cbdcb68a8 (refs/heads/fix/import-new-models-error)
want 53096ec1dbd068ab108176bf3640477533e6d2b0 (refs/heads/issue_19734_2)
want 927ab56c7753b86b0d3efe3bb35573c9caeeb27f (refs/heads/lfs-helper-doc-link)
want 1025b39058eec1b3a58cf8231edd6b2e3700ed22 (refs/heads/master)
want ae8025cdf73d33803a126467b8d8fc02c75f1a9f (refs/heads/update-runner-information)
want 0021cc2d0a7aad6476efda0c6d562b2015713e81 (refs/heads/zj-deployed-ago-keep-around-commit)
have da246355cfba388fe454c1f0c6af61f6c80e43eb
have 12a9d16ee60f5f1dd50203927c905f881d126f49
have 300b7763080765c6d62d2aaa63b99e8eb689f065
have 97551e8dd9dc5711951e865e7f9875f8cd5712ac
have abc97a587d853d6c2ac2a6181e5d811c210fd402
have f07ed85ac5824d27dc9eb68f06941eef2b583d68
have d776aaa2fb46e5a698ef81dbf8ce700f229f113a
have 918d63cd9ee0331ca2cc5d847613961f8767596d
have 43119dbfbbf931c0d084bf7159a706fb4b4edf75
have a55d7ab5cac222eccdabd6bd8297fc73d460f237
have 20de47235e39e585ac1c8746fc9c4f673da910a0
have ab7c00a3c51b1c8da7b08011486924b832fc225f
have 06d212585f2eed74e1805f3b66b89357d129cc03
have da1fa1e14f86c1deabe047f61e6526e4870a07c5
have 8a7adda1495c2c8b276e868b16d5467cac60e9e0
have de05cedc86062abded4d281a0ad93149feda1f0e
have f9ec3c88a73d6027315637a78771b1ca88c767c5
have a14c1e03130468b140aa94246f2a2e18dd960a80
have 0ef54d504c90146ffdbff5c699a40c689127b369
have db6b2b18990297d98bd74af1d2f475d0d42ec443
have e7ab6b70ebcc065dd2a98d6af44de7075f872f1e
have 6d40ebebbce5f3023138d2e5736352b3a004b64c
have 2753d665858fd640717d4da7bedbd6dd89e4624e
have 44d5be2e8a248657165f932d859a3be4f1ee9089
have dffd33252f029901e33883935b20f6b0368d819b
have ce77bc0bf0958578fd8f3aa7ea606154ae5346ab
have 6c8f32a03b61c794a891111f591084f0a6392be3
have b30d514438bbd2dab5b5af9cf0cce2f6a939f55c
have ca3c6a46674b29686b75fc7a70d29a407d801d51
have 5907ed8cb6398cc46b336ea7bbaf4eb5a00adb7b
have 9c64482ef2a1372e169af686a9c9f3d666a3019c
have ea5a2b17de92c69c7cfcb0340c2aec41f29635ae
got ack 3 da246355cfba388fe454c1f0c6af61f6c80e43eb
got ack 3 12a9d16ee60f5f1dd50203927c905f881d126f49
got ack 3 300b7763080765c6d62d2aaa63b99e8eb689f065
got ack 3 97551e8dd9dc5711951e865e7f9875f8cd5712ac
got ack 3 abc97a587d853d6c2ac2a6181e5d811c210fd402
got ack 3 f07ed85ac5824d27dc9eb68f06941eef2b583d68
got ack 3 d776aaa2fb46e5a698ef81dbf8ce700f229f113a
got ack 3 918d63cd9ee0331ca2cc5d847613961f8767596d
got ack 3 43119dbfbbf931c0d084bf7159a706fb4b4edf75
got ack 3 a55d7ab5cac222eccdabd6bd8297fc73d460f237
got ack 3 20de47235e39e585ac1c8746fc9c4f673da910a0
got ack 3 ab7c00a3c51b1c8da7b08011486924b832fc225f
got ack 3 06d212585f2eed74e1805f3b66b89357d129cc03
got ack 3 da1fa1e14f86c1deabe047f61e6526e4870a07c5
got ack 3 8a7adda1495c2c8b276e868b16d5467cac60e9e0
got ack 3 de05cedc86062abded4d281a0ad93149feda1f0e
got ack 4 de05cedc86062abded4d281a0ad93149feda1f0e
done
got ack (3) f9ec3c88a73d6027315637a78771b1ca88c767c5
got ack (3) a14c1e03130468b140aa94246f2a2e18dd960a80
got ack (3) 0ef54d504c90146ffdbff5c699a40c689127b369
got ack (3) db6b2b18990297d98bd74af1d2f475d0d42ec443
got ack (3) e7ab6b70ebcc065dd2a98d6af44de7075f872f1e
got ack (3) 6d40ebebbce5f3023138d2e5736352b3a004b64c
got ack (3) 2753d665858fd640717d4da7bedbd6dd89e4624e
got ack (3) 44d5be2e8a248657165f932d859a3be4f1ee9089
got ack (3) dffd33252f029901e33883935b20f6b0368d819b
got ack (3) ce77bc0bf0958578fd8f3aa7ea606154ae5346ab
got ack (3) 6c8f32a03b61c794a891111f591084f0a6392be3
got ack (3) b30d514438bbd2dab5b5af9cf0cce2f6a939f55c
got ack (3) ca3c6a46674b29686b75fc7a70d29a407d801d51
got ack (3) 5907ed8cb6398cc46b336ea7bbaf4eb5a00adb7b
got ack (3) 9c64482ef2a1372e169af686a9c9f3d666a3019c
got ack (3) ea5a2b17de92c69c7cfcb0340c2aec41f29635ae
got ack (4) ea5a2b17de92c69c7cfcb0340c2aec41f29635ae
got ack (1) ea5a2b17de92c69c7cfcb0340c2aec41f29635ae
remote: Counting objects: 537, done.
error: pack-objects died of signal 708/335)
error: git upload-pack: git-pack-objects died with error.
fatal: git upload-pack: aborting due to possible repository corruption on the remote side.
remote: aborting due to possible repository corruption on the remote side.
fatal: protocol error: bad pack header
It worked after a second/third retry.
After a brief discussion with @jacobvosmaer-gitlab he is suspicious of Bitmaps are making the process fail, so we are disabling it fleet wide to see if the problem goes away.
The process got a signal 7 (Bus error which points to mmap accessing the wrong chunk of memory under heavy load.
We are still investigating what can we do about it besides disabling Bitmaps