Revert "Merge branch 'update-rack-timeout' into 'master'"

As described in !36071 (comment 375280155), upgrading rack-timeout is fine. Removing require: false isn't, because it silently changes the default request timeout from 60s to 15s. It's cleanest to revert the whole MR and try again as it's pretty small and safe otherwise.

cc @ayufan