CI test suite hanging

Summary

Tests in CI occasionally hang, hanging at this line:

[gw1] [ 84%] PASSED tests/sources/zip.py::test_use_netrc[HTTP] 

See here, here and here for examples within a single pipeline.

Steps to reproduce

This doesn't happen consistently, but only seems to happen in the CI pipeline and not locally.

What is the current bug behavior?

Jobs hang, and will eventually reach timeout limit at 20 hours unless cancelled manually before hand. It seems that some other test is hanging earlier on, as only one of the workers is available after tests/artifactcache/expiry.py::test_artifact_too_large[500000], but it is always after test_use_netrc[HTTP] line that it hangs, with no further line suggesting an extra test is run.

What is the expected correct behavior?

Test suite to not hang.

Relevant logs and/or screenshots

Possible fixes

I'm not sure what the problem exactly is, but use of pytest-timeout might illuminate what's causing it, rather than have the test suite silently hang.

---