Skip to content

Prometheus gitlab_exporter_process gives 404

Summary

After updating to Gitlab 13.10 the gitlab_exporter endpoint /process gives a 404. We are using an external prometheus instance for monitoring. Other metrics like /sidekiq or /database work just fine.

Steps to reproduce

Set up gitlab.rb and prometheus according to https://docs.gitlab.com/13.10/ee/administration/monitoring/prometheus/index.html and do a curl gitlab.example.com:9168/process

What is the current bug behavior?

curl gitlab.example.com:9168/process returns a 404

What is the expected correct behavior?

curl gitlab.example.com:9168/process should return the metrics

Relevant logs

Relevant logs

gitlab-ctl tail:

2021-04-12_07:52:47.25070 192.168.XXX.YYY - - [12/Apr/2021:09:52:47 CEST] "GET /process HTTP/1.1" 404 543
2021-04-12_07:52:47.25072 - -> /process

Output of CURL:

<!DOCTYPE html>
<html>
<head>
  <style type="text/css">
  body { text-align:center;font-family:helvetica,arial;font-size:22px;
    color:#888;margin:20px}
  #c {margin:0 auto;width:500px;text-align:left}
  </style>
</head>
<body>
  <h2>Sinatra doesn’t know this ditty.</h2>
  <img src='http://gitlab.example.com:9168/__sinatra__/404.png'>
  <div id="c">
    Try this:
    <pre># in web_exporter.rb
class GitLab::Exporter::WebExporter
  get &#x27;&#x2F;process&#x27; do
    &quot;Hello World&quot;
  end
end
</pre>
  </div>
</body>
</html>

Details of package version

Provide the package version installation details 
dpkg-query -l "gitlab-*"
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name                                                              Version                               Architecture                          Description
+++-=================================================================-=====================================-=====================================-========================================================================================================================================
rc  gitlab-ce                                                         12.7.5-ce.0                           amd64                                 GitLab Community Edition (including NGINX, Postgres, Redis)
ii  gitlab-ee                                                         13.10.2-ee.0                          amd64                                 GitLab Enterprise Edition (including NGINX, Postgres, Redis)

Environment details

  • Operating System: "Debian GNU/Linux 9 (stretch)
  • Installation Target, remove incorrect values:
    • VM: VMWare ESXi 6.7
  • Installation Type, remove incorrect values:
    • Upgrade from version 13.4.1-ee
  • Is there any other software running on the machine: no
  • Is this a single or multiple node installation?
  • Resources
    • CPU: 8 vCores
    • Memory total: 16GB

Configuration details

Provide the relevant sections of `/etc/gitlab/gitlab.rb` 
prometheus['enable'] = false
gitlab_exporter['listen_address'] = '192.168.XXX.ZZZ'
# gitlab_exporter['listen_port'] = '9168'