Skip to content

Increase the timeout before aborting a storage access attempt

Bob Van Landuyt requested to merge bvl-increase-storage-check-timeout into master

To avoid most false positives of failing storage discussed in https://gitlab.com/gitlab-com/infrastructure/issues/2446#note_39190437.

In the past 7 days we only had a handful of peaks of IO-wait that exceeded 30 seconds:

nfs-file-08 as example: http://monitor.gitlab.net/dashboard/db/host-stats?refresh=1m&panelId=13&fullscreen&orgId=1&var-node=nfs-file-08.stor.gitlab.com&from=now-7d&to=now

Screen_Shot_2017-09-04_at_09.50.33

So this should take care of most of the one off failures.

/cc @stanhu @DouweM

Merge request reports