Nginx returns 504 when indexing larger repositories
During the execution of 2023-07-31: Reindex Zoekt projects (gitlab-com/gl-infra/production#16090 - closed) on staging I noticed that indexing of the project 278964
(gitlab-org/gitlab
) always fails with
Request failed with: #<HTTParty::Response:0x12ca050 parsed_response="<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body>\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx</center>\r\n</body>\r\n</html>\r\n", @response=#<Net::HTTPGatewayTimeout 504 Gateway Time-out readbody=true>, @headers={"server"=>["nginx"], "date"=>["Thu, 27 Jul 2023 18:41:38 GMT"], "content-type"=>["text/html"], "content-length"=>["160"], "connection"=>["close"]}>
Exactly 60 seconds after the job is triggered
source: https://nonprod-log.gitlab.net/app/r/s/RD1Ix
We need to bump up the timeout in the nginx configuration, otherwise it wouldn't be possible to index larger repositories with the new indexer.