All repository shows empty content after re-install ominibus-gitlab instance

Summary

I've re-install the Gitlab-ce_15.2.2 today then restore my backup tar file and gitlab-secrets.json after run 'sudo gitlab-ctl reconfigure' And I restart my gitlab instance then login on the webpage to check the repositories, all the directories and user privileges are there while the content are all empty for every single repository when I entered in.

Steps to reproduce

What I did is just following the instruction of Downgrade Not sure if this will help to reproduce

What is the current bug behavior?

All the repository stay it's origin structure while all their content are lost!

What is the expected correct behavior?

All the content were restored successfully

Relevant logs

yorick@CN-S-ZEVQDEX:/etc/gitlab$ sudo gitlab-ctl tail
==> /var/log/gitlab/gitlab-shell/gitlab-shell.log <==
{"correlation_id":"01FBGSZ2XBHS5BK694PNCVGRGE","duration_ms":3,"error":"Get \"http://127.0.0.1:8181/api/v4/internal/check\": dial tcp 127.0.0.1:8181: connect: connection refused","level":"error","method":"GET","msg":"Internal API unreachable","time":"2021-07-26T07:02:47Z","url":"http://127.0.0.1:8181/api/v4/internal/check"}
{"correlation_id":"01FBGT3TD6QF2XD91B15KNRZV4","duration_ms":0,"error":"Get \"http://127.0.0.1:8181/api/v4/internal/check\": dial tcp 127.0.0.1:8181: connect: connection refused","level":"error","method":"GET","msg":"Internal API unreachable","time":"2021-07-26T07:05:22Z","url":"http://127.0.0.1:8181/api/v4/internal/check"}
{"content_length_bytes":86,"correlation_id":"01GB27092570MK012QJSCCN6S0","duration_ms":157,"level":"info","method":"GET","msg":"Finished HTTP request","status":200,"time":"2022-08-22T07:24:20Z","url":"http://127.0.0.1:8181/api/v4/internal/check"}
{"content_length_bytes":86,"correlation_id":"01GB49ETMSMR4QT5YF2W29JGC9","duration_ms":83,"level":"info","method":"GET","msg":"Finished HTTP request","status":200,"time":"2022-08-23T02:45:42Z","url":"http://127.0.0.1:8181/api/v4/internal/check"}
{"correlation_id":"01GB4JD0CWGSWZQEPCD1D5Z645","duration_ms":1,"error":"Internal API error (502)","level":"error","method":"GET","msg":"Internal API error","status":502,"time":"2022-08-23T05:22:00Z","url":"http://127.0.0.1:8181/api/v4/internal/check"}
{"content_length_bytes":86,"correlation_id":"01GB4JFKQ8P19H7XTNTN4EKAC8","duration_ms":49,"level":"info","method":"GET","msg":"Finished HTTP request","status":200,"time":"2022-08-23T05:23:25Z","url":"http://127.0.0.1:8181/api/v4/internal/check"}

==> /var/log/gitlab/postgresql/current <==
2022-08-23_05:21:19.75113 received TERM from runit, sending INT instead to force quit connections
2022-08-23_05:21:19.75293 LOG:  received fast shutdown request
2022-08-23_05:21:19.75555 LOG:  aborting any active transactions
2022-08-23_05:21:19.75654 LOG:  background worker "logical replication launcher" (PID 13745) exited with exit code 1
2022-08-23_05:21:19.75924 LOG:  shutting down
2022-08-23_05:21:22.85985 LOG:  database system is shut down
2022-08-23_05:21:22.96248 LOG:  starting PostgreSQL 13.6 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0, 64-bit
2022-08-23_05:21:22.96489 LOG:  listening on Unix socket "/var/opt/gitlab/postgresql/.s.PGSQL.5432"
2022-08-23_05:21:23.03505 LOG:  database system was shut down at 2022-08-23 05:21:22 GMT
2022-08-23_05:21:23.04283 LOG:  database system is ready to accept connections

==> /var/log/gitlab/postgresql/state <==

==> /var/log/gitlab/gitaly/current <==
{"command.count":1,"command.cpu_time_ms":4,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":148,"command.oublock":0,"command.real_time_ms":6,"command.system_time_ms":4,"command.user_time_ms":0,"correlation_id":"01GB4N416F5CXQ59E0A12M0C67","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-workhorse","grpc.meta.deadline_type":"none","grpc.meta.method_type":"server_stream","grpc.method":"InfoRefsUploadPack","grpc.request.fullMethod":"/gitaly.SmartHTTPService/InfoRefsUploadPack","grpc.request.glProjectPath":"app/welcome/android/welcome-app","grpc.request.glRepository":"project-4","grpc.request.payload_bytes":151,"grpc.request.repoPath":"@hashed/4b/22/4b227777d4dd1fc61c6f884f48641d02b4d121d3fd328cb08b5531fcacdabf8a.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":202,"grpc.service":"gitaly.SmartHTTPService","grpc.start_time":"2022-08-23T14:09:32.299","grpc.time_ms":6.956,"level":"info","msg":"finished streaming call with code OK","peer.address":"@","pid":17179,"span.kind":"server","system":"grpc","time":"2022-08-23T06:09:32.306Z","user_id":"user-4","username":"ivan"}
{"correlation_id":"01GB4N41RPSCJAAEJTDKQ95C87","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-workhorse","grpc.meta.deadline_type":"none","grpc.meta.method_type":"unary","grpc.method":"PostUploadPackWithSidechannel","grpc.request.fullMethod":"/gitaly.SmartHTTPService/PostUploadPackWithSidechannel","grpc.request.glProjectPath":"app/welcome/android/welcome-app","grpc.request.glRepository":"project-4","grpc.request.repoPath":"@hashed/4b/22/4b227777d4dd1fc61c6f884f48641d02b4d121d3fd328cb08b5531fcacdabf8a.git","grpc.request.repoStorage":"default","grpc.service":"gitaly.SmartHTTPService","grpc.start_time":"2022-08-23T14:09:32.806","level":"info","msg":"request details","peer.address":"@","pid":17179,"request_sha":"7516aff79e37d78f53b3d1aafc23fd1b55181919","response_bytes":4,"span.kind":"server","system":"grpc","time":"2022-08-23T06:09:32.812Z","user_id":"user-4","username":"ivan"}
{"correlation_id":"01GB4N41RPSCJAAEJTDHZH8FQ6","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-workhorse","grpc.meta.deadline_type":"none","grpc.meta.method_type":"unary","grpc.method":"PostUploadPackWithSidechannel","grpc.request.fullMethod":"/gitaly.SmartHTTPService/PostUploadPackWithSidechannel","grpc.request.glProjectPath":"app/welcome/android/welcome-app","grpc.request.glRepository":"project-4","grpc.request.repoPath":"@hashed/4b/22/4b227777d4dd1fc61c6f884f48641d02b4d121d3fd328cb08b5531fcacdabf8a.git","grpc.request.repoStorage":"default","grpc.service":"gitaly.SmartHTTPService","grpc.start_time":"2022-08-23T14:09:32.806","level":"info","msg":"request details","peer.address":"@","pid":17179,"request_sha":"7516aff79e37d78f53b3d1aafc23fd1b55181919","response_bytes":4,"span.kind":"server","system":"grpc","time":"2022-08-23T06:09:32.813Z","user_id":"user-4","username":"ivan"}
{"command.count":1,"command.cpu_time_ms":4,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":156,"command.oublock":0,"command.real_time_ms":4,"command.system_time_ms":0,"command.user_time_ms":4,"correlation_id":"01GB4N41RPSCJAAEJTDKQ95C87","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-workhorse","grpc.meta.deadline_type":"none","grpc.meta.method_type":"unary","grpc.method":"PostUploadPackWithSidechannel","grpc.request.fullMethod":"/gitaly.SmartHTTPService/PostUploadPackWithSidechannel","grpc.request.glProjectPath":"app/welcome/android/welcome-app","grpc.request.glRepository":"project-4","grpc.request.payload_bytes":151,"grpc.request.repoPath":"@hashed/4b/22/4b227777d4dd1fc61c6f884f48641d02b4d121d3fd328cb08b5531fcacdabf8a.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":0,"grpc.service":"gitaly.SmartHTTPService","grpc.start_time":"2022-08-23T14:09:32.806","grpc.time_ms":6.41,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":17179,"span.kind":"server","system":"grpc","time":"2022-08-23T06:09:32.813Z","user_id":"user-4","username":"ivan"}
{"command.count":1,"command.cpu_time_ms":3,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":156,"command.oublock":0,"command.real_time_ms":4,"command.system_time_ms":3,"command.user_time_ms":0,"correlation_id":"01GB4N41RPSCJAAEJTDHZH8FQ6","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-workhorse","grpc.meta.deadline_type":"none","grpc.meta.method_type":"unary","grpc.method":"PostUploadPackWithSidechannel","grpc.request.fullMethod":"/gitaly.SmartHTTPService/PostUploadPackWithSidechannel","grpc.request.glProjectPath":"app/welcome/android/welcome-app","grpc.request.glRepository":"project-4","grpc.request.payload_bytes":151,"grpc.request.repoPath":"@hashed/4b/22/4b227777d4dd1fc61c6f884f48641d02b4d121d3fd328cb08b5531fcacdabf8a.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":0,"grpc.service":"gitaly.SmartHTTPService","grpc.start_time":"2022-08-23T14:09:32.806","grpc.time_ms":6.656,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":17179,"span.kind":"server","system":"grpc","time":"2022-08-23T06:09:32.813Z","user_id":"user-4","username":"ivan"}
{"level":"info","msg":"finished tempdir cleaner walk","storage":"default","time":"2022-08-23T06:21:20.749Z","time_ms":0}
{"command.count":1,"command.cpu_time_ms":3,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":152,"command.oublock":0,"command.real_time_ms":3,"command.system_time_ms":0,"command.user_time_ms":3,"correlation_id":"01GB4NXTCY5JZYG7GV8DGHBDCQ","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-web","grpc.meta.deadline_type":"regular","grpc.meta.method_type":"unary","grpc.method":"FindDefaultBranchName","grpc.request.deadline":"2022-08-23T14:23:47.002","grpc.request.fullMethod":"/gitaly.RefService/FindDefaultBranchName","grpc.request.glProjectPath":"globalip/ui/is","grpc.request.glRepository":"project-7","grpc.request.payload_bytes":122,"grpc.request.repoPath":"@hashed/79/02/7902699be42c8a8e46fbbb4501726517e86b22c56a189f7625a6da49081b2451.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":0,"grpc.service":"gitaly.RefService","grpc.start_time":"2022-08-23T14:23:37.102","grpc.time_ms":4.5,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":17179,"remote_ip":"125.35.78.118","span.kind":"server","system":"grpc","time":"2022-08-23T06:23:37.107Z","username":"jenkins"}
{"command.count":1,"command.cpu_time_ms":3,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":150,"command.oublock":0,"command.real_time_ms":3,"command.system_time_ms":3,"command.user_time_ms":0,"correlation_id":"01GB4NXTCY5JZYG7GV8DGHBDCQ","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-web","grpc.meta.deadline_type":"regular","grpc.meta.method_type":"unary","grpc.method":"HasLocalBranches","grpc.request.deadline":"2022-08-23T14:23:47.005","grpc.request.fullMethod":"/gitaly.RepositoryService/HasLocalBranches","grpc.request.glProjectPath":"globalip/ui/is","grpc.request.glRepository":"project-7","grpc.request.payload_bytes":122,"grpc.request.repoPath":"@hashed/79/02/7902699be42c8a8e46fbbb4501726517e86b22c56a189f7625a6da49081b2451.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":0,"grpc.service":"gitaly.RepositoryService","grpc.start_time":"2022-08-23T14:23:37.135","grpc.time_ms":3.832,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":17179,"remote_ip":"125.35.78.118","span.kind":"server","system":"grpc","time":"2022-08-23T06:23:37.139Z","username":"jenkins"}
{"command.count":1,"command.cpu_time_ms":5,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":147,"command.oublock":0,"command.real_time_ms":5,"command.system_time_ms":0,"command.user_time_ms":5,"correlation_id":"01GB4PGFXFFKPYZWPC7QWCTQ50","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-web","grpc.meta.deadline_type":"regular","grpc.meta.method_type":"unary","grpc.method":"FindDefaultBranchName","grpc.request.deadline":"2022-08-23T14:33:59.006","grpc.request.fullMethod":"/gitaly.RefService/FindDefaultBranchName","grpc.request.glProjectPath":"globalip/ui/is","grpc.request.glRepository":"project-7","grpc.request.payload_bytes":122,"grpc.request.repoPath":"@hashed/79/02/7902699be42c8a8e46fbbb4501726517e86b22c56a189f7625a6da49081b2451.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":0,"grpc.service":"gitaly.RefService","grpc.start_time":"2022-08-23T14:33:49.036","grpc.time_ms":6.359,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":17179,"remote_ip":"125.35.78.118","span.kind":"server","system":"grpc","time":"2022-08-23T06:33:49.043Z","username":"jenkins"}
{"command.count":1,"command.cpu_time_ms":4,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":149,"command.oublock":0,"command.real_time_ms":5,"command.system_time_ms":4,"command.user_time_ms":0,"correlation_id":"01GB4PGFXFFKPYZWPC7QWCTQ50","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-web","grpc.meta.deadline_type":"regular","grpc.meta.method_type":"unary","grpc.method":"HasLocalBranches","grpc.request.deadline":"2022-08-23T14:33:59.003","grpc.request.fullMethod":"/gitaly.RepositoryService/HasLocalBranches","grpc.request.glProjectPath":"globalip/ui/is","grpc.request.glRepository":"project-7","grpc.request.payload_bytes":122,"grpc.request.repoPath":"@hashed/79/02/7902699be42c8a8e46fbbb4501726517e86b22c56a189f7625a6da49081b2451.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":0,"grpc.service":"gitaly.RepositoryService","grpc.start_time":"2022-08-23T14:33:49.234","grpc.time_ms":6.401,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":17179,"remote_ip":"125.35.78.118","span.kind":"server","system":"grpc","time":"2022-08-23T06:33:49.240Z","username":"jenkins"}

==> /var/log/gitlab/gitaly/gitaly_ruby_json.log <==
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:34:56Z","grpc.time_ms":0.395,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17264,"correlation_id":"c001535030b937c855572e0ae3226d0f","time":"2022-08-23T06:34:56.994Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:34:56Z","grpc.time_ms":0.414,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17266,"correlation_id":"54be11f5d6d07ac4ec0247916a5e7ad6","time":"2022-08-23T06:34:56.997Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:35:11Z","grpc.time_ms":0.631,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17264,"correlation_id":"0ad5da667e0a0fab43a7a6548223e2c3","time":"2022-08-23T06:35:11.998Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:35:11Z","grpc.time_ms":0.462,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17266,"correlation_id":"fecb6c25ece39e6d788325d410035105","time":"2022-08-23T06:35:11.999Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:35:27Z","grpc.time_ms":0.386,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17264,"correlation_id":"a3560c1a0d5a34fea3f10f28e3127f10","time":"2022-08-23T06:35:27.001Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:35:27Z","grpc.time_ms":0.464,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17266,"correlation_id":"f372760d6e99c6c5e257a9aa0e9843e8","time":"2022-08-23T06:35:27.001Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:35:42Z","grpc.time_ms":0.422,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17264,"correlation_id":"2850eda4400a10079e46887b7dea5d33","time":"2022-08-23T06:35:42.004Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:35:42Z","grpc.time_ms":0.419,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17266,"correlation_id":"387445b54d225203c263ac962441247e","time":"2022-08-23T06:35:42.004Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:35:57Z","grpc.time_ms":0.216,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17266,"correlation_id":"f24111796d66818b1e18036525b14ac0","time":"2022-08-23T06:35:57.006Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:35:57Z","grpc.time_ms":0.218,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17264,"correlation_id":"e9e50fd214c1f857c6883322e5b370ab","time":"2022-08-23T06:35:57.006Z"}

==> /var/log/gitlab/gitaly/state <==

==> /var/log/gitlab/gitaly/gitaly_hooks.log <==
time="2020-05-30T04:06:10Z" level=error msg="error when executing ruby hook: exit status 1"
time="2020-05-30T04:06:26Z" level=error msg="error when executing ruby hook: exit status 1"
time="2020-09-07T03:07:56Z" level=error msg="error when executing ruby hook: exit status 1"
time="2020-09-07T03:08:23Z" level=error msg="error when executing ruby hook: exit status 1"
time="2020-11-02T12:43:47Z" level=error msg="error when executing ruby hook: exit status 1"
time="2020-12-21T08:08:30Z" level=error msg="error when executing ruby hook: exit status 1"
time="2021-03-03T08:19:16Z" level=error msg="error when executing ruby hook: exit status 1"

==> /var/log/gitlab/gitaly/gitlab-shell.log <==
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/post_receive","duration":0.072787723,"gitaly_embedded":true,"pid":1550,"level":"info","msg":"finished HTTP request","time":"2021-06-08T10:23:23+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/allowed","duration":0.093799325,"gitaly_embedded":true,"pid":5189,"level":"info","msg":"finished HTTP request","time":"2021-06-08T10:26:47+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/pre_receive","duration":0.014688114,"gitaly_embedded":true,"pid":5189,"level":"info","msg":"finished HTTP request","time":"2021-06-08T10:26:47+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/post_receive","duration":0.123334741,"gitaly_embedded":true,"pid":5229,"level":"info","msg":"finished HTTP request","time":"2021-06-08T10:26:48+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/allowed","duration":0.122408113,"gitaly_embedded":true,"pid":11457,"level":"info","msg":"finished HTTP request","time":"2021-06-08T11:36:34+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/pre_receive","duration":0.02982205,"gitaly_embedded":true,"pid":11457,"level":"info","msg":"finished HTTP request","time":"2021-06-08T11:36:34+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/post_receive","duration":0.046368655,"gitaly_embedded":true,"pid":11503,"level":"info","msg":"finished HTTP request","time":"2021-06-08T11:36:34+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/allowed","duration":0.244738089,"gitaly_embedded":true,"pid":30313,"level":"info","msg":"finished HTTP request","time":"2021-06-08T17:46:22+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/pre_receive","duration":0.017375716,"gitaly_embedded":true,"pid":30313,"level":"info","msg":"finished HTTP request","time":"2021-06-08T17:46:22+08:00"}
{"method":"POST","url":"http://127.0.0.1:8080/api/v4/internal/post_receive","duration":0.028651856,"gitaly_embedded":true,"pid":30383,"level":"info","msg":"finished HTTP request","time":"2021-06-08T17:46:23+08:00"}

==> /var/log/gitlab/gitlab-workhorse/current <==
{"content_type":"","correlation_id":"01GB4NXWA8GZJSSS609PJDQ8WN","duration_ms":112,"host":"58.32.237.86:9200","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"http://58.32.237.86:9200/globalip/ui/is","remote_addr":"125.35.78.118:33896","remote_ip":"125.35.78.118","route":"","status":304,"system":"http","time":"2022-08-23T14:23:38+08:00","ttfb_ms":112,"uri":"/uploads/-/system/appearance/header_logo/1/abb.png","user_agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","written_bytes":0}
{"content_type":"text/html; charset=utf-8","correlation_id":"01GB4P1867VRBNSMK9PN31Z9M5","duration_ms":189,"host":"58.32.237.86:9200","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"","remote_addr":"107.189.31.223:33924","remote_ip":"107.189.31.223","route":"","status":200,"system":"http","time":"2022-08-23T14:25:29+08:00","ttfb_ms":188,"uri":"/users/sign_in","user_agent":"python-requests/2.25.1","written_bytes":25424}
{"content_type":"text/html; charset=utf-8","correlation_id":"01GB4P1APRH0Y3ZAD9CQR07Y16","duration_ms":35,"host":"58.32.237.86:9200","level":"info","method":"POST","msg":"access","proto":"HTTP/1.1","referrer":"","remote_addr":"107.189.31.223:33928","remote_ip":"107.189.31.223","route":"^/uploads/user","status":422,"system":"http","time":"2022-08-23T14:25:31+08:00","ttfb_ms":35,"uri":"/uploads/user","user_agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2227.0 Safari/537.36","written_bytes":3035}
{"content_type":"text/html; charset=utf-8","correlation_id":"01GB4PE23774RVEH4QFS4JTAF1","duration_ms":207,"host":"58.32.237.86:9200","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"","remote_addr":"107.189.31.223:34020","remote_ip":"107.189.31.223","route":"","status":200,"system":"http","time":"2022-08-23T14:32:29+08:00","ttfb_ms":206,"uri":"/users/sign_in","user_agent":"python-requests/2.25.1","written_bytes":25424}
{"content_type":"text/html; charset=utf-8","correlation_id":"01GB4PE4VYTX7XTCMQ96A0G8YA","duration_ms":65,"host":"58.32.237.86:9200","level":"info","method":"POST","msg":"access","proto":"HTTP/1.1","referrer":"","remote_addr":"107.189.31.223:34024","remote_ip":"107.189.31.223","route":"^/uploads/user","status":422,"system":"http","time":"2022-08-23T14:32:31+08:00","ttfb_ms":65,"uri":"/uploads/user","user_agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2227.0 Safari/537.36","written_bytes":3035}
{"content_type":"text/html; charset=utf-8","correlation_id":"01GB4PGFXFFKPYZWPC7QWCTQ50","duration_ms":2746,"host":"58.32.237.86:9200","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"http://58.32.237.86:9200/","remote_addr":"125.35.78.118:34042","remote_ip":"125.35.78.118","route":"","status":200,"system":"http","time":"2022-08-23T14:33:51+08:00","ttfb_ms":2745,"uri":"/globalip/ui/is","user_agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","written_bytes":113005}
{"correlation_id":"01GB4PGK0VD4AKPVZAQ5E4VHA9","duration_s":0.000245678,"imageresizer.content_type":"image/png","imageresizer.original_filesize":20668,"imageresizer.status":"success-client-cache","imageresizer.target_width":"23","level":"info","method":"GET","msg":"success-client-cache","subsystem":"imageresizer","time":"2022-08-23T14:33:51+08:00","uri":"/uploads/-/system/user/avatar/2/avatar.png?width=23","written_bytes":0}
{"content_type":"","correlation_id":"01GB4PGK0VD4AKPVZAQ5E4VHA9","duration_ms":69,"host":"58.32.237.86:9200","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"http://58.32.237.86:9200/globalip/ui/is","remote_addr":"125.35.78.118:34048","remote_ip":"125.35.78.118","route":"","status":304,"system":"http","time":"2022-08-23T14:33:51+08:00","ttfb_ms":69,"uri":"/uploads/-/system/user/avatar/2/avatar.png?width=23","user_agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","written_bytes":0}
{"correlation_id":"01GB4PGJZNRCM7DYYCZZSTF7F9","file":"/opt/gitlab/embedded/service/gitlab-rails/public/uploads/-/system/appearance/header_logo/1/abb.png","level":"info","method":"GET","msg":"Send file","time":"2022-08-23T14:33:52+08:00","uri":"/uploads/-/system/appearance/header_logo/1/abb.png"}
{"content_type":"","correlation_id":"01GB4PGJZNRCM7DYYCZZSTF7F9","duration_ms":432,"host":"58.32.237.86:9200","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"http://58.32.237.86:9200/globalip/ui/is","remote_addr":"125.35.78.118:34046","remote_ip":"125.35.78.118","route":"","status":304,"system":"http","time":"2022-08-23T14:33:52+08:00","ttfb_ms":432,"uri":"/uploads/-/system/appearance/header_logo/1/abb.png","user_agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","written_bytes":0}

==> /var/log/gitlab/gitlab-workhorse/state <==

==> /var/log/gitlab/unicorn/current <==
2021-06-08_10:10:17.25174 wrapper for unicorn master 13951 exiting
2021-06-08_10:49:49.44623 starting new unicorn master
2021-06-08_10:51:06.83591 adopted new unicorn master 10586
2021-06-08_11:41:57.22464 Received TERM from runit, sending to process group (-PID)
2021-06-08_11:41:57.22627 Terminated
2021-06-08_11:41:57.22641 forwarding TERM to unicorn master 10586
2021-06-08_11:41:57.22781 Waiting for unicorn to die...
2021-06-08_11:41:58.23232 forwarding CONT to unicorn master 10586
2021-06-08_11:41:58.23239 /opt/gitlab/embedded/bin/gitlab-unicorn-wrapper: line 132: kill: (10586) - No such process
2021-06-08_11:41:58.23251 wrapper for unicorn master 10586 exiting

==> /var/log/gitlab/unicorn/unicorn_stderr.log <==

==> /var/log/gitlab/unicorn/state <==

==> /var/log/gitlab/unicorn/unicorn_stdout.log <==

==> /var/log/gitlab/sidekiq/current <==
{"severity":"INFO","time":"2022-08-23T06:35:27.528Z","retry":0,"queue":"cronjob:schedule_merge_request_cleanup_refs","version":0,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"47ddf3915eaaadcbfbc50722","created_at":"2022-08-23T06:35:27.443Z","meta.caller_id":"Cronjob","correlation_id":"716abc9aa9b3afc2479de478a2a2b129","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:schedule_merge_request_cleanup_refs:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.484Z","job_size_bytes":2,"pid":17389,"message":"ScheduleMergeRequestCleanupRefsWorker JID-47ddf3915eaaadcbfbc50722: done: 0.039784 sec","job_status":"done","scheduling_latency_s":0.004599,"redis_calls":2,"redis_duration_s":0.005385,"redis_read_bytes":213,"redis_write_bytes":445,"redis_cache_calls":1,"redis_cache_duration_s":0.003054,"redis_cache_read_bytes":203,"redis_cache_write_bytes":61,"redis_queues_calls":1,"redis_queues_duration_s":0.002331,"redis_queues_read_bytes":10,"redis_queues_write_bytes":384,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.006829,"mem_objects":1258,"mem_bytes":135896,"mem_mallocs":319,"mem_total_bytes":186216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.039784,"completed_at":"2022-08-23T06:35:27.528Z","load_balancing_strategy":"primary","db_duration_s":0.0}
{"severity":"INFO","time":"2022-08-23T06:35:27.758Z","retry":0,"queue":"cronjob:database_batched_background_migration","version":0,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a497c0b2f30cf3fed1279055","created_at":"2022-08-23T06:35:27.520Z","meta.caller_id":"Cronjob","correlation_id":"5c663d8cc8a1494b39377caa56455747","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:database_batched_background_migration:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2022-08-23T06:35:27.522Z","job_size_bytes":2,"pid":17389,"message":"Database::BatchedBackgroundMigrationWorker JID-a497c0b2f30cf3fed1279055: done: 0.232866 sec","job_status":"done","scheduling_latency_s":0.003325,"redis_calls":2,"redis_duration_s":0.0016250000000000001,"redis_read_bytes":132,"redis_write_bytes":423,"redis_cache_calls":1,"redis_cache_duration_s":0.000303,"redis_cache_read_bytes":122,"redis_cache_write_bytes":35,"redis_queues_calls":1,"redis_queues_duration_s":0.001322,"redis_queues_read_bytes":10,"redis_queues_write_bytes":388,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_duration_s":0.028,"db_main_replica_duration_s":0.0,"cpu_s":0.012006,"mem_objects":1732,"mem_bytes":141888,"mem_mallocs":390,"mem_total_bytes":211168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.232866,"completed_at":"2022-08-23T06:35:27.758Z","load_balancing_strategy":"primary","db_duration_s":0.027703}
{"severity":"INFO","time":"2022-08-23T06:35:27.760Z","retry":0,"queue":"cronjob:ci_update_locked_unknown_artifacts","version":0,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"736aa1cd37474b0938206228","created_at":"2022-08-23T06:35:27.749Z","meta.caller_id":"Cronjob","correlation_id":"7bc83eef652cbbc16e63b521051b9f5c","meta.root_caller_id":"Cronjob","meta.feature_category":"build_artifacts","worker_data_consistency":"sticky","wal_locations":{},"wal_location_source":"primary","idempotency_key":"resque:gitlab:duplicate:cronjob:ci_update_locked_unknown_artifacts:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.751Z","job_size_bytes":2,"pid":17389,"message":"Ci::UpdateLockedUnknownArtifactsWorker JID-736aa1cd37474b0938206228: start","job_status":"start","scheduling_latency_s":0.008434}
{"severity":"INFO","time":"2022-08-23T06:35:27.843Z","retry":0,"queue":"cronjob:user_status_cleanup_batch","version":0,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3246676682a4a211b445bf22","created_at":"2022-08-23T06:35:27.837Z","meta.caller_id":"Cronjob","correlation_id":"13f361bc989a89b09974d086f80bcea0","meta.root_caller_id":"Cronjob","meta.feature_category":"users","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:user_status_cleanup_batch:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.839Z","job_size_bytes":2,"pid":17389,"message":"UserStatusCleanup::BatchWorker JID-3246676682a4a211b445bf22: start","job_status":"start","scheduling_latency_s":0.00359}
{"severity":"INFO","time":"2022-08-23T06:35:27.860Z","retry":0,"queue":"cronjob:ci_update_locked_unknown_artifacts","version":0,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"736aa1cd37474b0938206228","created_at":"2022-08-23T06:35:27.749Z","meta.caller_id":"Cronjob","correlation_id":"7bc83eef652cbbc16e63b521051b9f5c","meta.root_caller_id":"Cronjob","meta.feature_category":"build_artifacts","worker_data_consistency":"sticky","wal_locations":{},"wal_location_source":"primary","idempotency_key":"resque:gitlab:duplicate:cronjob:ci_update_locked_unknown_artifacts:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.751Z","job_size_bytes":2,"pid":17389,"message":"Ci::UpdateLockedUnknownArtifactsWorker JID-736aa1cd37474b0938206228: done: 0.100324 sec","job_status":"done","scheduling_latency_s":0.008434,"redis_calls":2,"redis_duration_s":0.000571,"redis_read_bytes":213,"redis_write_bytes":446,"redis_cache_calls":1,"redis_cache_duration_s":0.000301,"redis_cache_read_bytes":203,"redis_cache_write_bytes":64,"redis_queues_calls":1,"redis_queues_duration_s":0.00027,"redis_queues_read_bytes":10,"redis_queues_write_bytes":382,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.007187,"mem_objects":1263,"mem_bytes":156424,"mem_mallocs":320,"mem_total_bytes":206944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.100324,"completed_at":"2022-08-23T06:35:27.860Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0}
{"severity":"INFO","time":"2022-08-23T06:35:27.904Z","retry":0,"queue":"cronjob:expire_build_artifacts","version":0,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"f78f57f3dd84a3970e3d5685","created_at":"2022-08-23T06:35:27.898Z","meta.caller_id":"Cronjob","correlation_id":"716cee751657232ca836f80a6d8de982","meta.root_caller_id":"Cronjob","meta.feature_category":"build_artifacts","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:expire_build_artifacts:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.900Z","job_size_bytes":2,"pid":17389,"message":"ExpireBuildArtifactsWorker JID-f78f57f3dd84a3970e3d5685: start","job_status":"start","scheduling_latency_s":0.00396}
{"severity":"INFO","time":"2022-08-23T06:35:27.907Z","retry":0,"queue":"cronjob:user_status_cleanup_batch","version":0,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3246676682a4a211b445bf22","created_at":"2022-08-23T06:35:27.837Z","meta.caller_id":"Cronjob","correlation_id":"13f361bc989a89b09974d086f80bcea0","meta.root_caller_id":"Cronjob","meta.feature_category":"users","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:user_status_cleanup_batch:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.839Z","job_size_bytes":2,"pid":17389,"message":"UserStatusCleanup::BatchWorker JID-3246676682a4a211b445bf22: done: 0.064394 sec","job_status":"done","scheduling_latency_s":0.00359,"redis_calls":1,"redis_duration_s":0.002658,"redis_read_bytes":10,"redis_write_bytes":364,"redis_queues_calls":1,"redis_queues_duration_s":0.002658,"redis_queues_read_bytes":10,"redis_queues_write_bytes":364,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_duration_s":0.034,"db_main_replica_duration_s":0.0,"cpu_s":0.00868,"mem_objects":1313,"mem_bytes":88272,"mem_mallocs":274,"mem_total_bytes":140792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.064394,"completed_at":"2022-08-23T06:35:27.907Z","load_balancing_strategy":"primary","db_duration_s":0.034319}
{"severity":"INFO","time":"2022-08-23T06:35:27.984Z","retry":0,"queue":"cronjob:loose_foreign_keys_cleanup","version":0,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5f49c5ca31a73b1ebb1f01e1","created_at":"2022-08-23T06:35:27.964Z","meta.caller_id":"Cronjob","correlation_id":"95deb4b62d132d41ceb3626f862bc556","meta.root_caller_id":"Cronjob","meta.feature_category":"pods","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:loose_foreign_keys_cleanup:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.966Z","job_size_bytes":2,"pid":17389,"message":"LooseForeignKeys::CleanupWorker JID-5f49c5ca31a73b1ebb1f01e1: start","job_status":"start","scheduling_latency_s":0.018672}
{"severity":"INFO","time":"2022-08-23T06:35:27.996Z","retry":0,"queue":"cronjob:expire_build_artifacts","version":0,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"f78f57f3dd84a3970e3d5685","created_at":"2022-08-23T06:35:27.898Z","meta.caller_id":"Cronjob","correlation_id":"716cee751657232ca836f80a6d8de982","meta.root_caller_id":"Cronjob","meta.feature_category":"build_artifacts","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:expire_build_artifacts:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.900Z","job_size_bytes":2,"pid":17389,"message":"ExpireBuildArtifactsWorker JID-f78f57f3dd84a3970e3d5685: done: 0.092669 sec","job_status":"done","scheduling_latency_s":0.00396,"redis_calls":4,"redis_duration_s":0.0047810000000000005,"redis_read_bytes":215,"redis_write_bytes":730,"redis_cache_calls":1,"redis_cache_duration_s":0.000311,"redis_cache_read_bytes":203,"redis_cache_write_bytes":68,"redis_queues_calls":1,"redis_queues_duration_s":0.000378,"redis_queues_read_bytes":10,"redis_queues_write_bytes":358,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004092,"redis_shared_state_read_bytes":2,"redis_shared_state_write_bytes":304,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_duration_s":0.012,"db_main_replica_duration_s":0.0,"cpu_s":0.012098,"mem_objects":1780,"mem_bytes":228032,"mem_mallocs":430,"mem_total_bytes":299232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"extra.expire_build_artifacts_worker.destroyed_job_artifacts_count":0,"duration_s":0.092669,"completed_at":"2022-08-23T06:35:27.996Z","load_balancing_strategy":"primary","db_duration_s":0.012133}
{"severity":"INFO","time":"2022-08-23T06:35:28.038Z","retry":0,"queue":"cronjob:loose_foreign_keys_cleanup","version":0,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5f49c5ca31a73b1ebb1f01e1","created_at":"2022-08-23T06:35:27.964Z","meta.caller_id":"Cronjob","correlation_id":"95deb4b62d132d41ceb3626f862bc556","meta.root_caller_id":"Cronjob","meta.feature_category":"pods","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:loose_foreign_keys_cleanup:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2022-08-23T06:35:27.966Z","job_size_bytes":2,"pid":17389,"message":"LooseForeignKeys::CleanupWorker JID-5f49c5ca31a73b1ebb1f01e1: done: 0.053704 sec","job_status":"done","scheduling_latency_s":0.018672,"redis_calls":3,"redis_duration_s":0.007882,"redis_read_bytes":12,"redis_write_bytes":768,"redis_queues_calls":1,"redis_queues_duration_s":0.000378,"redis_queues_read_bytes":10,"redis_queues_write_bytes":366,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007504,"redis_shared_state_read_bytes":2,"redis_shared_state_write_bytes":402,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":9,"db_main_count":9,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_duration_s":0.006,"db_main_replica_duration_s":0.0,"cpu_s":0.035784,"mem_objects":5412,"mem_bytes":313896,"mem_mallocs":1072,"mem_total_bytes":530376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main"},"duration_s":0.053704,"completed_at":"2022-08-23T06:35:28.038Z","load_balancing_strategy":"primary","db_duration_s":0.011148}

==> /var/log/gitlab/sidekiq/state <==

==> /var/log/gitlab/redis-exporter/current <==
2022-08-23_02:29:18.89809 time="2022-08-23T10:29:18+08:00" level=info msg="Redis Metrics Exporter 1.33.0    build date:     sha1:     Go: go1.17.6    GOOS: linux    GOARCH: amd64"
2022-08-23_02:29:18.89811 time="2022-08-23T10:29:18+08:00" level=info msg="Providing metrics at localhost:9121/metrics"
2022-08-23_02:30:20.41919 time="2022-08-23T10:30:20+08:00" level=info msg="Redis Metrics Exporter 1.33.0    build date:     sha1:     Go: go1.17.6    GOOS: linux    GOARCH: amd64"
2022-08-23_02:30:20.41986 time="2022-08-23T10:30:20+08:00" level=info msg="Providing metrics at localhost:9121/metrics"
2022-08-23_03:34:11.18321 time="2022-08-23T11:34:11+08:00" level=info msg="Redis Metrics Exporter 1.33.0    build date:     sha1:     Go: go1.17.6    GOOS: linux    GOARCH: amd64"
2022-08-23_03:34:11.18405 time="2022-08-23T11:34:11+08:00" level=info msg="Providing metrics at localhost:9121/metrics"
2022-08-23_05:03:53.86116 time="2022-08-23T13:03:53+08:00" level=info msg="Redis Metrics Exporter 1.33.0    build date:     sha1:     Go: go1.17.6    GOOS: linux    GOARCH: amd64"
2022-08-23_05:03:53.86119 time="2022-08-23T13:03:53+08:00" level=info msg="Providing metrics at localhost:9121/metrics"
2022-08-23_05:21:24.43703 time="2022-08-23T13:21:24+08:00" level=info msg="Redis Metrics Exporter 1.33.0    build date:     sha1:     Go: go1.17.6    GOOS: linux    GOARCH: amd64"
2022-08-23_05:21:24.43770 time="2022-08-23T13:21:24+08:00" level=info msg="Providing metrics at localhost:9121/metrics"

==> /var/log/gitlab/redis-exporter/state <==

==> /var/log/gitlab/node-exporter/current <==
2022-08-23_05:21:18.91737 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:115 level=info collector=thermal_zone
2022-08-23_05:21:18.91739 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:115 level=info collector=time
2022-08-23_05:21:18.91739 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:115 level=info collector=timex
2022-08-23_05:21:18.91741 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:115 level=info collector=udp_queues
2022-08-23_05:21:18.91741 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:115 level=info collector=uname
2022-08-23_05:21:18.91742 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:115 level=info collector=vmstat
2022-08-23_05:21:18.91744 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:115 level=info collector=xfs
2022-08-23_05:21:18.91744 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:115 level=info collector=zfs
2022-08-23_05:21:18.91765 ts=2022-08-23T05:21:18.917Z caller=node_exporter.go:199 level=info msg="Listening on" address=localhost:9100
2022-08-23_05:21:18.91808 ts=2022-08-23T05:21:18.918Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false

==> /var/log/gitlab/node-exporter/state <==

==> /var/log/gitlab/prometheus/current <==
2022-08-23_05:21:27.53216 level=info ts=2022-08-23T05:21:27.532Z caller=main.go:852 msg="TSDB started"
2022-08-23_05:21:27.53217 level=info ts=2022-08-23T05:21:27.532Z caller=main.go:979 msg="Loading configuration file" filename=/var/opt/gitlab/prometheus/prometheus.yml
2022-08-23_05:21:27.53366 level=error ts=2022-08-23T05:21:27.533Z caller=manager.go:316 component="discovery manager scrape" msg="Cannot create service discovery" err="unable to load specified CA cert /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory" type=kubernetes
2022-08-23_05:21:27.53374 level=error ts=2022-08-23T05:21:27.533Z caller=manager.go:316 component="discovery manager scrape" msg="Cannot create service discovery" err="unable to load specified CA cert /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory" type=kubernetes
2022-08-23_05:21:27.53383 level=error ts=2022-08-23T05:21:27.533Z caller=manager.go:316 component="discovery manager scrape" msg="Cannot create service discovery" err="unable to load specified CA cert /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory" type=kubernetes
2022-08-23_05:21:27.54287 level=info ts=2022-08-23T05:21:27.542Z caller=main.go:1016 msg="Completed loading of configuration file" filename=/var/opt/gitlab/prometheus/prometheus.yml totalDuration=10.64674ms db_storage=1.24µs remote_storage=2.181µs web_handler=770ns query_engine=1.398µs scrape=72.545µs scrape_sd=440.504µs notify=18.679µs notify_sd=18.61µs rules=8.775569ms
2022-08-23_05:21:27.54290 level=info ts=2022-08-23T05:21:27.542Z caller=main.go:794 msg="Server is ready to receive web requests."
2022-08-23_05:21:32.54398 level=error ts=2022-08-23T05:21:32.543Z caller=manager.go:196 component="scrape manager" msg="error creating new scrape pool" err="error creating HTTP client: unable to load specified CA cert /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory" scrape_pool=kubernetes-nodes
2022-08-23_05:21:32.54401 level=error ts=2022-08-23T05:21:32.543Z caller=manager.go:196 component="scrape manager" msg="error creating new scrape pool" err="error creating HTTP client: unable to load specified CA cert /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory" scrape_pool=kubernetes-pods
2022-08-23_05:21:32.54401 level=error ts=2022-08-23T05:21:32.543Z caller=manager.go:196 component="scrape manager" msg="error creating new scrape pool" err="error creating HTTP client: unable to load specified CA cert /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory" scrape_pool=kubernetes-cadvisor

==> /var/log/gitlab/prometheus/state <==

==> /var/log/gitlab/logrotate/current <==
2022-08-23_05:31:18.06688 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/gitlab-kas because it is writable by group or others.
2022-08-23_05:31:18.06699 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/gitaly because it is writable by group or others.
2022-08-23_06:31:18.12895 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/nginx because it is writable by group or others.
2022-08-23_06:31:18.12906 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/puma because it is writable by group or others.
2022-08-23_06:31:18.12917 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/gitlab-rails because it is writable by group or others.
2022-08-23_06:31:18.12927 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/gitlab-shell because it is writable by group or others.
2022-08-23_06:31:18.12937 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/gitlab-workhorse because it is writable by group or others.
2022-08-23_06:31:18.12949 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/gitlab-pages because it is writable by group or others.
2022-08-23_06:31:18.12959 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/gitlab-kas because it is writable by group or others.
2022-08-23_06:31:18.12976 error: Ignoring /var/opt/gitlab/logrotate/logrotate.d/gitaly because it is writable by group or others.

==> /var/log/gitlab/logrotate/state <==

==> /var/log/gitlab/gitlab-exporter/current <==
2022-08-23_06:35:45.78890 - -> /database
2022-08-23_06:35:53.97936 127.0.0.1 - - [23/Aug/2022:14:35:53 CST] "GET /ruby HTTP/1.1" 200 1001
2022-08-23_06:35:53.97953 - -> /ruby
2022-08-23_06:35:59.12395 Passing 'exists?' command to redis as is; blind passthrough has been deprecated and will be removed in redis-namespace 2.0 (at /opt/gitlab/embedded/lib/ruby/gems/2.7.0/gems/sidekiq-6.4.0/lib/sidekiq/api.rb:962:in `block (3 levels) in each')
2022-08-23_06:35:59.15562 127.0.0.1 - - [23/Aug/2022:14:35:58 CST] "GET /sidekiq HTTP/1.1" 200 86564
2022-08-23_06:35:59.15568 - -> /sidekiq
2022-08-23_06:36:00.72719 127.0.0.1 - - [23/Aug/2022:14:36:00 CST] "GET /database HTTP/1.1" 200 3862
2022-08-23_06:36:00.72725 - -> /database
2022-08-23_06:36:08.94731 127.0.0.1 - - [23/Aug/2022:14:36:08 CST] "GET /ruby HTTP/1.1" 200 1001
2022-08-23_06:36:08.94738 - -> /ruby

==> /var/log/gitlab/gitlab-exporter/state <==

==> /var/log/gitlab/postgres-exporter/current <==
2022-08-23_06:36:04.06109 ts=2022-08-23T06:36:04.061Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_database
2022-08-23_06:36:04.06528 ts=2022-08-23T06:36:04.065Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_locks
2022-08-23_06:36:04.06711 ts=2022-08-23T06:36:04.067Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_bgwriter
2022-08-23_06:36:04.07059 ts=2022-08-23T06:36:04.070Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stuck_idle_in_transaction
2022-08-23_06:36:04.07235 ts=2022-08-23T06:36:04.072Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_total_relation_size
2022-08-23_06:36:04.26716 ts=2022-08-23T06:36:04.266Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_vacuum_analyze
2022-08-23_06:36:04.26903 ts=2022-08-23T06:36:04.268Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_postmaster
2022-08-23_06:36:04.26941 ts=2022-08-23T06:36:04.269Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_blocked
2022-08-23_06:36:04.27097 ts=2022-08-23T06:36:04.270Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_database_conflicts
2022-08-23_06:36:04.27465 ts=2022-08-23T06:36:04.274Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_activity

==> /var/log/gitlab/postgres-exporter/state <==

==> /var/log/gitlab/nginx/current <==

==> /var/log/gitlab/nginx/state <==

==> /var/log/gitlab/nginx/gitlab_error.log <==
2022/01/25 15:53:05 [error] 28180#0: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 154.16.113.87, server: 58.32.237.86, request: "GET /users/sign_in HTTP/1.1", upstream: "http://127.0.0.1:8181/users/sign_in", host: "58.32.237.86:9200"
2022/01/25 15:53:11 [error] 28180#0: *3 connect() failed (111: Connection refused) while connecting to upstream, client: 198.98.55.101, server: 58.32.237.86, request: "GET /users/sign_in HTTP/1.1", upstream: "http://127.0.0.1:8181/users/sign_in", host: "58.32.237.86:9200"

==> /var/log/gitlab/nginx/error.log <==
2022/06/20 15:02:11 [emerg] 6616#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:12 [emerg] 6617#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:13 [emerg] 6620#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:15 [emerg] 6630#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:16 [emerg] 6631#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:17 [emerg] 6644#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:18 [emerg] 6645#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:19 [emerg] 6649#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:20 [emerg] 6664#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20
2022/06/20 15:02:21 [emerg] 6669#0: unknown directive "hide_server_tokens" in /var/opt/gitlab/nginx/conf/nginx.conf:20

==> /var/log/gitlab/nginx/access.log <==

==> /var/log/gitlab/nginx/gitlab_access.log <==
125.35.78.118 - - [23/Aug/2022:14:23:38 +0800] "GET /globalip/ui/is HTTP/1.1" 200 24172 "http://58.32.237.86:9200/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" 4.68
125.35.78.118 - - [23/Aug/2022:14:23:38 +0800] "GET /uploads/-/system/user/avatar/2/avatar.png?width=23 HTTP/1.1" 304 0 "http://58.32.237.86:9200/globalip/ui/is" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" -
125.35.78.118 - - [23/Aug/2022:14:23:38 +0800] "GET /uploads/-/system/appearance/header_logo/1/abb.png HTTP/1.1" 304 0 "http://58.32.237.86:9200/globalip/ui/is" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" -
107.189.31.223 - - [23/Aug/2022:14:25:29 +0800] "GET /users/sign_in HTTP/1.1" 200 7665 "" "python-requests/2.25.1" 3.32
107.189.31.223 - - [23/Aug/2022:14:25:33 +0800] "POST /uploads/user HTTP/1.1" 422 3035 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2227.0 Safari/537.36" -
107.189.31.223 - - [23/Aug/2022:14:32:29 +0800] "GET /users/sign_in HTTP/1.1" 200 7656 "" "python-requests/2.25.1" 3.33
107.189.31.223 - - [23/Aug/2022:14:32:32 +0800] "POST /uploads/user HTTP/1.1" 422 3035 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2227.0 Safari/537.36" -
125.35.78.118 - - [23/Aug/2022:14:33:51 +0800] "GET /globalip/ui/is HTTP/1.1" 200 24170 "http://58.32.237.86:9200/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" 4.68
125.35.78.118 - - [23/Aug/2022:14:33:51 +0800] "GET /uploads/-/system/user/avatar/2/avatar.png?width=23 HTTP/1.1" 304 0 "http://58.32.237.86:9200/globalip/ui/is" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" -
125.35.78.118 - - [23/Aug/2022:14:33:52 +0800] "GET /uploads/-/system/appearance/header_logo/1/abb.png HTTP/1.1" 304 0 "http://58.32.237.86:9200/globalip/ui/is" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" -

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2022-06-20-15-04-31.log <==

==> /var/log/gitlab/gitlab-rails/audit_json.log <==
{"severity":"INFO","time":"2022-08-12T03:47:28.179Z","correlation_id":"01GA82KZGKZTTGZD7RH59WYX1X","author_id":42,"author_name":"allen","entity_id":42,"entity_type":"User","created_at":"2022-08-12T03:47:28.178+00:00","with":"standard","target_id":42,"target_type":"User","target_details":"allen"}
{"severity":"INFO","time":"2022-08-16T01:34:22.612Z","correlation_id":"01GAJ4K576WHF8YHS4535YGCDE","author_id":34,"author_name":"Beta-ChenYi Quan","entity_id":34,"entity_type":"User","created_at":"2022-08-16T01:34:22.611+00:00","with":"standard","target_id":34,"target_type":"User","target_details":"Beta-ChenYi Quan"}
{"severity":"INFO","time":"2022-08-16T04:52:01.979Z","correlation_id":"01GAJFX2VEQW9E3FPY6E6R3ADR","author_id":2,"author_name":"jenkins","entity_id":2,"entity_type":"User","created_at":"2022-08-16T04:52:01.959+00:00","with":"standard","target_id":2,"target_type":"User","target_details":"jenkins"}
{"severity":"INFO","time":"2022-08-16T06:59:08.786Z","correlation_id":"01GAJQ5TVY5DWVWDD96VE3EA3Z","author_id":2,"author_name":"jenkins","entity_id":2,"entity_type":"User","created_at":"2022-08-16T06:59:08.786+00:00","with":"standard","target_id":2,"target_type":"User","target_details":"jenkins"}
{"severity":"INFO","time":"2022-08-16T07:28:36.670Z","correlation_id":"01GAJRVS6H06W1CEZJGC6YH051","author_id":15,"author_name":"shelly-yunqing.ye","entity_id":15,"entity_type":"User","created_at":"2022-08-16T07:28:36.670+00:00","with":"standard","target_id":15,"target_type":"User","target_details":"shelly-yunqing.ye"}
{"severity":"INFO","time":"2022-08-22T06:16:54.218Z","correlation_id":"01GB234S75CW5YASBYDXF4H839","author_id":2,"author_name":"jenkins","entity_id":2,"entity_type":"User","created_at":"2022-08-22T06:16:54.217+00:00","with":"standard","target_id":2,"target_type":"User","target_details":"jenkins"}
{"severity":"INFO","time":"2022-08-22T06:31:50.439Z","correlation_id":"01GB2404VHHY2GGEV967GKDQCS","author_id":26,"author_name":"Mingze Wei","entity_id":26,"entity_type":"User","created_at":"2022-08-22T06:31:50.438+00:00","with":"standard","target_id":26,"target_type":"User","target_details":"Mingze Wei"}
{"severity":"INFO","time":"2022-08-22T07:11:01.045Z","correlation_id":"01GB267WD2B58Z3PESWD438H6B","author_id":2,"author_name":"jenkins","entity_id":2,"entity_type":"User","created_at":"2022-08-22T07:11:01.044+00:00","with":"standard","target_id":2,"target_type":"User","target_details":"jenkins"}
{"severity":"INFO","time":"2022-08-22T07:21:11.188Z","correlation_id":"01GB26TG5FPKVKYS8W9563G83N","author_id":2,"author_name":"jenkins","entity_id":2,"entity_type":"User","created_at":"2022-08-22T07:21:11.187+00:00","with":"standard","target_id":2,"target_type":"User","target_details":"jenkins"}
{"severity":"INFO","time":"2022-08-23T02:04:00.982Z","correlation_id":"01GB472E27Z6FQWMZ6A1DQGJTE","author_id":2,"author_name":"jenkins","entity_id":2,"entity_type":"User","created_at":"2022-08-23T02:04:00.981+00:00","with":"standard","target_id":2,"target_type":"User","target_details":"jenkins"}

==> /var/log/gitlab/gitlab-rails/auth.log <==
{"severity":"INFO","time":"2022-08-23T05:21:45.979Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:21:49.117Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:21:55.973Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:22:23.656Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:23:20.927Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:23:48.180Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:25:13.422Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:26:08.790Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:26:47.610Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}
{"severity":"INFO","time":"2022-08-23T05:27:24.052Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]}

==> /var/log/gitlab/gitlab-rails/sidekiq_client.log <==
{"severity":"WARN","time":"2022-06-17T00:47:23.532Z","message":"Job arguments to ExternalServiceReactiveCachingWorker do not serialize to JSON safely. This will raise an error in\nSidekiq 7.0. See https://github.com/mperham/sidekiq/wiki/Best-Practices or raise an error today\nby calling `Sidekiq.strict_args!` during Sidekiq initialization.\n"}
{"severity":"WARN","time":"2022-06-17T01:06:03.366Z","message":"Job arguments to ExternalServiceReactiveCachingWorker do not serialize to JSON safely. This will raise an error in\nSidekiq 7.0. See https://github.com/mperham/sidekiq/wiki/Best-Practices or raise an error today\nby calling `Sidekiq.strict_args!` during Sidekiq initialization.\n"}
{"severity":"WARN","time":"2022-06-30T00:38:21.580Z","message":"Job arguments to ExternalServiceReactiveCachingWorker do not serialize to JSON safely. This will raise an error in\nSidekiq 7.0. See https://github.com/mperham/sidekiq/wiki/Best-Practices or raise an error today\nby calling `Sidekiq.strict_args!` during Sidekiq initialization.\n"}
{"severity":"INFO","time":"2022-08-04T03:04:23.488Z","retry":3,"queue":"authorized_project_update:authorized_project_update_user_refresh_from_replica","version":0,"queue_namespace":"authorized_project_update","class":"AuthorizedProjectUpdate::UserRefreshFromReplicaWorker","args":["15"],"jid":"1d462f184f04a6ed3721e628","created_at":"2022-08-04T03:04:23.484Z","enqueued_at":"2022-08-04T03:04:23.484Z","at":1659585863,"correlation_id":"01G9KCZBSG3TSEZAYXC10JHN0S","meta.user":"Zhuyue.Zhang","meta.client_id":"user/40","meta.caller_id":"POST /api/:version/projects/:id/invitations","meta.remote_ip":"125.35.78.118","meta.feature_category":"authentication_and_authorization","meta.related_class":"POST /api/:version/projects/:id/invitations","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:authorized_project_update:authorized_project_update_user_refresh_from_replica:4fd341c6e7fcc4a139bb1500427b9399e289c35be8acb99f9794864d77e3706a","duplicate-of":"7e6178502c3960ecbbc8ebe5","job_size_bytes":4,"pid":8836,"job_status":"deduplicated","message":"AuthorizedProjectUpdate::UserRefreshFromReplicaWorker JID-1d462f184f04a6ed3721e628: deduplicated: dropped until executing","deduplication.type":"dropped until executing","deduplication.options.including_scheduled":true}
{"severity":"INFO","time":"2022-08-04T03:05:38.104Z","retry":3,"queue":"authorized_project_update:authorized_project_update_user_refresh_from_replica","version":0,"queue_namespace":"authorized_project_update","class":"AuthorizedProjectUpdate::UserRefreshFromReplicaWorker","args":["15"],"jid":"3deab5b7d27cf8549c8332ee","created_at":"2022-08-04T03:05:38.101Z","enqueued_at":"2022-08-04T03:05:38.101Z","at":1659585938,"correlation_id":"01G9KD1MSV4CD2YC50ZTWRMGSS","meta.user":"Zhuyue.Zhang","meta.client_id":"user/40","meta.caller_id":"POST /api/:version/projects/:id/invitations","meta.remote_ip":"125.35.78.118","meta.feature_category":"authentication_and_authorization","meta.related_class":"POST /api/:version/projects/:id/invitations","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:authorized_project_update:authorized_project_update_user_refresh_from_replica:4fd341c6e7fcc4a139bb1500427b9399e289c35be8acb99f9794864d77e3706a","duplicate-of":"7e6178502c3960ecbbc8ebe5","job_size_bytes":4,"pid":7600,"job_status":"deduplicated","message":"AuthorizedProjectUpdate::UserRefreshFromReplicaWorker JID-3deab5b7d27cf8549c8332ee: deduplicated: dropped until executing","deduplication.type":"dropped until executing","deduplication.options.including_scheduled":true}
{"severity":"INFO","time":"2022-08-04T03:05:50.389Z","retry":3,"queue":"authorized_project_update:authorized_project_update_user_refresh_from_replica","version":0,"queue_namespace":"authorized_project_update","class":"AuthorizedProjectUpdate::UserRefreshFromReplicaWorker","args":["39"],"jid":"2534e9efdb9e8bc1b9e51f3e","created_at":"2022-08-04T03:05:50.386Z","enqueued_at":"2022-08-04T03:05:50.386Z","at":1659585950,"correlation_id":"01G9KD20W6G5WHVNVXQWHMJ8ES","meta.user":"allen-caijian.zhang","meta.project":"fts_ui/fts_2.6","meta.root_namespace":"fts_ui","meta.client_id":"user/42","meta.caller_id":"Projects::ProjectMembersController#update","meta.remote_ip":"218.107.193.72","meta.feature_category":"authentication_and_authorization","meta.related_class":"Projects::ProjectMembersController#update","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:authorized_project_update:authorized_project_update_user_refresh_from_replica:5e9cec81e0437ef4ab35ca950a13435b5d804202328845681d9719f66a3ac603","duplicate-of":"716cc5df246545899944b768","job_size_bytes":4,"pid":10810,"job_status":"deduplicated","message":"AuthorizedProjectUpdate::UserRefreshFromReplicaWorker JID-2534e9efdb9e8bc1b9e51f3e: deduplicated: dropped until executing","deduplication.type":"dropped until executing","deduplication.options.including_scheduled":true}
{"severity":"INFO","time":"2022-08-04T03:06:03.213Z","retry":3,"queue":"authorized_project_update:authorized_project_update_user_refresh_from_replica","version":0,"queue_namespace":"authorized_project_update","class":"AuthorizedProjectUpdate::UserRefreshFromReplicaWorker","args":["15"],"jid":"6925f387e6595d6bc7c8ab71","created_at":"2022-08-04T03:06:03.209Z","enqueued_at":"2022-08-04T03:06:03.209Z","at":1659585963,"correlation_id":"01G9KD2D3EJ7WXQH2Q3JYMKFEK","meta.user":"Zhuyue.Zhang","meta.client_id":"user/40","meta.caller_id":"POST /api/:version/projects/:id/invitations","meta.remote_ip":"125.35.78.118","meta.feature_category":"authentication_and_authorization","meta.related_class":"POST /api/:version/projects/:id/invitations","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:authorized_project_update:authorized_project_update_user_refresh_from_replica:4fd341c6e7fcc4a139bb1500427b9399e289c35be8acb99f9794864d77e3706a","duplicate-of":"7e6178502c3960ecbbc8ebe5","job_size_bytes":4,"pid":10810,"job_status":"deduplicated","message":"AuthorizedProjectUpdate::UserRefreshFromReplicaWorker JID-6925f387e6595d6bc7c8ab71: deduplicated: dropped until executing","deduplication.type":"dropped until executing","deduplication.options.including_scheduled":true}
{"severity":"WARN","time":"2022-08-22T06:40:45.189Z","message":"Job arguments to ExternalServiceReactiveCachingWorker do not serialize to JSON safely. This will raise an error in\nSidekiq 7.0. See https://github.com/mperham/sidekiq/wiki/Best-Practices or raise an error today\nby calling `Sidekiq.strict_args!` during Sidekiq initialization.\n"}
{"severity":"WARN","time":"2022-08-22T07:39:35.581Z","message":"Job arguments to ExternalServiceReactiveCachingWorker do not serialize to JSON safely. This will raise an error in\nSidekiq 7.0. See https://github.com/mperham/sidekiq/wiki/Best-Practices or raise an error today\nby calling `Sidekiq.strict_args!` during Sidekiq initialization.\n"}
{"severity":"WARN","time":"2022-08-23T02:32:45.002Z","message":"Job arguments to ExternalServiceReactiveCachingWorker do not serialize to JSON safely. This will raise an error in\nSidekiq 7.0. See https://github.com/mperham/sidekiq/wiki/Best-Practices or raise an error today\nby calling `Sidekiq.strict_args!` during Sidekiq initialization.\n"}

==> /var/log/gitlab/gitlab-rails/importer.log <==

==> /var/log/gitlab/gitlab-rails/migrations.log <==
{"severity":"INFO","time":"2022-08-23T01:20:19.495Z","correlation_id":null,"method":"with_lock_retries","class":"RemoveDescriptionHtmlLimit","message":"Lock timeout is set","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.497Z","correlation_id":null,"method":"with_lock_retries","class":"RemoveDescriptionHtmlLimit","message":"Migration finished","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.559Z","correlation_id":null,"method":"with_lock_retries","class":"CreateMlExperiments","message":"Lock timeout is set","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.593Z","correlation_id":null,"method":"with_lock_retries","class":"CreateMlExperiments","message":"Migration finished","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.600Z","correlation_id":null,"method":"with_lock_retries","class":"CreateMlCandidates","message":"Lock timeout is set","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.634Z","correlation_id":null,"method":"with_lock_retries","class":"CreateMlCandidates","message":"Migration finished","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.758Z","correlation_id":null,"method":"with_lock_retries","class":"AddMlCandidatesReferenceToExperiment","message":"Lock timeout is set","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.761Z","correlation_id":null,"method":"with_lock_retries","class":"AddMlCandidatesReferenceToExperiment","message":"Migration finished","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.800Z","correlation_id":null,"method":"with_lock_retries","class":"AddMlExperimentsReferenceToProject","message":"Lock timeout is set","current_iteration":1,"lock_timeout_in_ms":100}
{"severity":"INFO","time":"2022-08-23T01:20:19.804Z","correlation_id":null,"method":"with_lock_retries","class":"AddMlExperimentsReferenceToProject","message":"Migration finished","current_iteration":1,"lock_timeout_in_ms":100}

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2021-06-09-10-23-31.log <==
-- index_exists?(:members, [:source_id, :source_type], {:where=>"requested_at IS NULL and type = 'ProjectMember'", :name=>"index_non_requested_project_members_on_source_id_and_type", :algorithm=>:concurrently})
   -> 0.0105s
-- execute("SET statement_timeout TO 0")
   -> 0.0005s
-- add_index(:members, [:source_id, :source_type], {:where=>"requested_at IS NULL and type = 'ProjectMember'", :name=>"index_non_requested_project_members_on_source_id_and_type", :algorithm=>:concurrently})
   -> 0.0106s
-- execute("RESET ALL")
   -> 0.0006s
== 20200515155620 AddIndexNonRequestedProjectMembersOnSourceIdSourceType: migrated (0.0234s)


==> /var/log/gitlab/gitlab-rails/application_json.log <==
{"severity":"INFO","time":"2022-08-23T06:21:13.578Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Checking state of dynamic postgres partitions","table_name":"incident_management_pending_alert_escalations","connection_name":"main"}
{"severity":"DEBUG","time":"2022-08-23T06:21:13.608Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Switched database connection","connection_name":"main"}
{"severity":"INFO","time":"2022-08-23T06:21:13.608Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Checking state of dynamic postgres partitions","table_name":"incident_management_pending_issue_escalations","connection_name":"main"}
{"severity":"DEBUG","time":"2022-08-23T06:21:13.639Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Switched database connection","connection_name":"main"}
{"severity":"INFO","time":"2022-08-23T06:21:13.639Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Checking state of dynamic postgres partitions","table_name":"verification_codes","connection_name":"main"}
{"severity":"INFO","time":"2022-08-23T06:21:13.669Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Finished sync of dynamic postgres partitions"}
{"severity":"DEBUG","time":"2022-08-23T06:21:13.670Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Switched database connection","connection_name":"main"}
{"severity":"DEBUG","time":"2022-08-23T06:21:13.705Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Switched database connection","connection_name":"main"}
{"severity":"DEBUG","time":"2022-08-23T06:21:13.722Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Switched database connection","connection_name":"main"}
{"severity":"DEBUG","time":"2022-08-23T06:21:13.736Z","correlation_id":"f896b044481e0896e369347be93d4d53","message":"Switched database connection","connection_name":"main"}

==> /var/log/gitlab/gitlab-rails/production_json.log <==
{"method":"GET","path":"/uploads/-/system/appearance/header_logo/1/abb.png","format":"html","controller":"UploadsController","action":"show","status":200,"time":"2022-08-23T06:33:52.285Z","params":[{"key":"model","value":"appearance"},{"key":"mounted_as","value":"header_logo"},{"key":"id","value":"1"},{"key":"filename","value":"abb.png"}],"correlation_id":"01GB4PGJZNRCM7DYYCZZSTF7F9","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"UploadsController#show","meta.remote_ip":"125.35.78.118","meta.feature_category":"not_owned","remote_ip":"125.35.78.118","user_id":2,"username":"jenkins","ua":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","queue_duration_s":0.054773,"request_urgency":"default","target_duration_s":1,"redis_calls":3,"redis_duration_s":0.002757,"redis_read_bytes":385,"redis_write_bytes":1766,"redis_cache_calls":1,"redis_cache_duration_s":0.000505,"redis_cache_read_bytes":202,"redis_cache_write_bytes":61,"redis_shared_state_calls":1,"redis_shared_state_duration_s":0.001116,"redis_shared_state_write_bytes":53,"redis_sessions_calls":1,"redis_sessions_duration_s":0.001136,"redis_sessions_read_bytes":183,"redis_sessions_write_bytes":1652,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":4,"db_main_count":4,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_duration_s":0.015,"db_main_replica_duration_s":0.0,"cpu_s":0.408195,"mem_objects":75050,"mem_bytes":4799670,"mem_mallocs":13411,"mem_total_bytes":7801670,"pid":17590,"worker_id":"puma_1","rate_limiting_gates":[],"db_duration_s":0.00215,"view_duration_s":0.0,"duration_s":0.02611}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:34:04.181Z","params":[],"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.110252,"mem_objects":1884,"mem_bytes":866456,"mem_mallocs":4414,"mem_total_bytes":941816,"pid":17588,"worker_id":"puma_0","rate_limiting_gates":[],"correlation_id":"346a5f4d-464f-4601-85f3-bc1058a12a80","db_duration_s":0.0,"view_duration_s":0.00157,"duration_s":0.09665}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:34:19.174Z","params":[],"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.103924,"mem_objects":1884,"mem_bytes":866456,"mem_mallocs":4414,"mem_total_bytes":941816,"pid":17592,"worker_id":"puma_2","rate_limiting_gates":[],"correlation_id":"c2003ae2-651d-4793-b2da-c48f8a8a1d13","db_duration_s":0.0,"view_duration_s":0.00119,"duration_s":0.09363}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:34:34.175Z","params":[],"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.103952,"mem_objects":1883,"mem_bytes":866456,"mem_mallocs":4414,"mem_total_bytes":941776,"pid":17592,"worker_id":"puma_2","rate_limiting_gates":[],"correlation_id":"6f751bf7-81b1-48a0-8a8d-dca79879ef86","db_duration_s":0.0,"view_duration_s":0.00122,"duration_s":0.09477}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:34:49.163Z","params":[],"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.093085,"mem_objects":1883,"mem_bytes":866456,"mem_mallocs":4414,"mem_total_bytes":941776,"pid":17592,"worker_id":"puma_2","rate_limiting_gates":[],"correlation_id":"ba8a4933-de85-45da-af7c-5f9a3bcc6cc3","db_duration_s":0.0,"view_duration_s":0.00107,"duration_s":0.08502}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:35:04.180Z","params":[],"redis_calls":2,"redis_duration_s":0.00171,"redis_read_bytes":406,"redis_write_bytes":200,"redis_cache_calls":2,"redis_cache_duration_s":0.00171,"redis_cache_read_bytes":406,"redis_cache_write_bytes":200,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.109124,"mem_objects":2261,"mem_bytes":980184,"mem_mallocs":4601,"mem_total_bytes":1070624,"pid":17588,"worker_id":"puma_0","rate_limiting_gates":[],"correlation_id":"c46ba0a9-332f-4304-b67f-2d1098d3feff","db_duration_s":0.0,"view_duration_s":0.00134,"duration_s":0.09389}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:35:19.176Z","params":[],"redis_calls":2,"redis_duration_s":0.001536,"redis_read_bytes":406,"redis_write_bytes":200,"redis_cache_calls":2,"redis_cache_duration_s":0.001536,"redis_cache_read_bytes":406,"redis_cache_write_bytes":200,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.105984,"mem_objects":2261,"mem_bytes":980184,"mem_mallocs":4601,"mem_total_bytes":1070624,"pid":17592,"worker_id":"puma_2","rate_limiting_gates":[],"correlation_id":"ac4dccb0-e096-47ec-ba2b-2e1390a1cbae","db_duration_s":0.0,"view_duration_s":0.00164,"duration_s":0.09345}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:35:34.116Z","params":[],"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.046418,"mem_objects":1883,"mem_bytes":869848,"mem_mallocs":4417,"mem_total_bytes":945168,"pid":17588,"worker_id":"puma_0","rate_limiting_gates":[],"correlation_id":"398d7135-5e45-4ec1-8b12-2f8272c22e82","db_duration_s":0.0,"view_duration_s":0.00065,"duration_s":0.04155}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:35:49.182Z","params":[],"redis_calls":2,"redis_duration_s":0.001974,"redis_read_bytes":406,"redis_write_bytes":200,"redis_cache_calls":2,"redis_cache_duration_s":0.001974,"redis_cache_read_bytes":406,"redis_cache_write_bytes":200,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.110439,"mem_objects":2260,"mem_bytes":980120,"mem_mallocs":4600,"mem_total_bytes":1070520,"pid":17593,"worker_id":"puma_3","rate_limiting_gates":[],"correlation_id":"efd368a9-8601-4451-b8a3-9e788c5df973","db_duration_s":0.0,"view_duration_s":0.00132,"duration_s":0.09377}
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:36:04.174Z","params":[],"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.103408,"mem_objects":1883,"mem_bytes":866456,"mem_mallocs":4414,"mem_total_bytes":941776,"pid":17588,"worker_id":"puma_0","rate_limiting_gates":[],"correlation_id":"444c5dff-395a-46aa-9cb8-771e79fd7235","db_duration_s":0.0,"view_duration_s":0.0013,"duration_s":0.09305}

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2020-01-08-12-59-49.log <==

==> /var/log/gitlab/gitlab-rails/sidekiq_exporter.log <==
[2021-06-09T10:51:13.386+0800] 127.0.0.1 - - [09/Jun/2021:10:51:13 CST] "GET /metrics HTTP/1.1" 200 8433 "-" "Prometheus/2.16.0"
[2021-06-09T10:51:28.400+0800] 127.0.0.1 - - [09/Jun/2021:10:51:28 CST] "GET /metrics HTTP/1.1" 200 8439 "-" "Prometheus/2.16.0"
[2021-06-09T10:51:43.400+0800] 127.0.0.1 - - [09/Jun/2021:10:51:43 CST] "GET /metrics HTTP/1.1" 200 8439 "-" "Prometheus/2.16.0"
[2021-06-09T10:51:58.401+0800] 127.0.0.1 - - [09/Jun/2021:10:51:58 CST] "GET /metrics HTTP/1.1" 200 8432 "-" "Prometheus/2.16.0"
[2021-06-09T10:52:13.564+0800] 127.0.0.1 - - [09/Jun/2021:10:52:13 CST] "GET /metrics HTTP/1.1" 200 8432 "-" "Prometheus/2.16.0"
[2021-06-09T10:52:28.395+0800] 127.0.0.1 - - [09/Jun/2021:10:52:28 CST] "GET /metrics HTTP/1.1" 200 8432 "-" "Prometheus/2.16.0"
[2021-06-09T10:52:43.386+0800] 127.0.0.1 - - [09/Jun/2021:10:52:43 CST] "GET /metrics HTTP/1.1" 200 8424 "-" "Prometheus/2.16.0"
[2021-06-09T10:52:58.400+0800] 127.0.0.1 - - [09/Jun/2021:10:52:58 CST] "GET /metrics HTTP/1.1" 200 8424 "-" "Prometheus/2.16.0"
[2021-06-09T10:53:03.267+0800] INFO  going to shutdown ...
[2021-06-09T10:53:03.267+0800] INFO  WEBrick::HTTPServer#start done.

==> /var/log/gitlab/gitlab-rails/database_load_balancing.log <==
{"severity":"DEBUG","time":"2022-08-23T05:23:47.757Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":false}
{"severity":"DEBUG","time":"2022-08-23T05:23:47.759Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true}
{"severity":"DEBUG","time":"2022-08-23T05:25:12.991Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":false}
{"severity":"DEBUG","time":"2022-08-23T05:25:12.992Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true}
{"severity":"DEBUG","time":"2022-08-23T05:26:07.793Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":false}
{"severity":"DEBUG","time":"2022-08-23T05:26:07.794Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true}
{"severity":"DEBUG","time":"2022-08-23T05:26:47.063Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":false}
{"severity":"DEBUG","time":"2022-08-23T05:26:47.065Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true}
{"severity":"DEBUG","time":"2022-08-23T05:27:23.537Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":false}
{"severity":"DEBUG","time":"2022-08-23T05:27:23.539Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true}

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2019-12-27-14-18-58.log <==

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2019-12-16-10-37-14.log <==

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2021-07-27-10-57-25.log <==
-- index_exists?(:packages_packages, [:project_id, :name, :version], {:unique=>true, :where=>"package_type = 11", :name=>"index_packages_on_project_id_name_version_unique_when_helm", :algorithm=>:concurrently})
   -> 0.0154s
-- execute("SET statement_timeout TO 0")
   -> 0.0005s
-- add_index(:packages_packages, [:project_id, :name, :version], {:unique=>true, :where=>"package_type = 11", :name=>"index_packages_on_project_id_name_version_unique_when_helm", :algorithm=>:concurrently})
   -> 0.0112s
-- execute("RESET ALL")
   -> 0.0006s
== 20210614143954 AddUniqueIndexForHelmPackages: migrated (0.0290s) ===========


==> /var/log/gitlab/gitlab-rails/backup_json.log <==
{"severity":"INFO","time":"2022-08-23T05:16:15.084Z","correlation_id":null,"message":"Cleaning up /var/opt/gitlab/backups/artifacts.tar.gz"}
{"severity":"INFO","time":"2022-08-23T05:16:15.085Z","correlation_id":null,"message":"Cleaning up /var/opt/gitlab/backups/pages.tar.gz"}
{"severity":"INFO","time":"2022-08-23T05:16:15.085Z","correlation_id":null,"message":"Cleaning up /var/opt/gitlab/backups/lfs.tar.gz"}
{"severity":"INFO","time":"2022-08-23T05:16:15.086Z","correlation_id":null,"message":"Cleaning up /var/opt/gitlab/backups/terraform_state.tar.gz"}
{"severity":"INFO","time":"2022-08-23T05:16:15.087Z","correlation_id":null,"message":"Cleaning up /var/opt/gitlab/backups/packages.tar.gz"}
{"severity":"INFO","time":"2022-08-23T05:16:15.088Z","correlation_id":null,"message":"Deleting tar staging files ... done"}
{"severity":"INFO","time":"2022-08-23T05:16:15.088Z","correlation_id":null,"message":"Deleting backups/tmp ... "}
{"severity":"INFO","time":"2022-08-23T05:16:15.898Z","correlation_id":null,"message":"Deleting backups/tmp ... done"}
{"severity":"INFO","time":"2022-08-23T05:16:15.898Z","correlation_id":null,"message":"Warning: Your gitlab.rb and gitlab-secrets.json files contain sensitive data \nand are not included in this backup. You will need to restore these files manually."}
{"severity":"INFO","time":"2022-08-23T05:16:15.898Z","correlation_id":null,"message":"Restore task is done."}

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2022-06-14-11-26-53.log <==
== 20210914095310 CleanupOrphanProjectAccessTokens: migrated (0.0986s) ========

== 20210915202900 PrepareIndexResourceGroupStatusCommitIdForCiBuilds: migrating
== 20210915202900 PrepareIndexResourceGroupStatusCommitIdForCiBuilds: migrated (0.0019s)

== 20210929144453 AddWarnAboutPotentiallyUnwantedCharactersToProjectSettings: migrating
-- add_column(:project_settings, :warn_about_potentially_unwanted_characters, :boolean, {:null=>false, :default=>true})
   -> 0.0023s
== 20210929144453 AddWarnAboutPotentiallyUnwantedCharactersToProjectSettings: migrated (0.0024s)


==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2022-08-23-09-19-12.log <==
main: -- execute("ALTER TABLE ml_experiments\nADD CONSTRAINT fk_ad89c59858\nFOREIGN KEY (project_id)\nREFERENCES projects (id)\nON DELETE CASCADE\nNOT VALID;\n")
main:    -> 0.0033s
main: -- execute("SET statement_timeout TO 0")
main:    -> 0.0008s
main: -- execute("ALTER TABLE ml_experiments VALIDATE CONSTRAINT fk_ad89c59858;")
main:    -> 0.0042s
main: -- execute("RESET statement_timeout")
main:    -> 0.0008s
main: == 20220811092253 AddMlExperimentsReferenceToProject: migrated (0.0374s) ======


==> /var/log/gitlab/gitlab-rails/production.log <==
Completed 200 OK in 93ms (Views: 1.6ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 930)
Started GET "/-/metrics" for 127.0.0.1 at 2022-08-23 14:35:34 +0800
Processing by MetricsController#index as HTML
Completed 200 OK in 41ms (Views: 0.6ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 930)
Started GET "/-/metrics" for 127.0.0.1 at 2022-08-23 14:35:49 +0800
Processing by MetricsController#index as HTML
Completed 200 OK in 93ms (Views: 1.3ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 930)
Started GET "/-/metrics" for 127.0.0.1 at 2022-08-23 14:36:04 +0800
Processing by MetricsController#index as HTML
Completed 200 OK in 93ms (Views: 1.3ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 930)

==> /var/log/gitlab/gitlab-rails/git_json.log <==
# Logfile created on 2021-06-10 09:30:26 +0800 by logger.rb/v1.4.2

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2019-12-30-08-43-35.log <==

==> /var/log/gitlab/gitlab-rails/exceptions_json.log <==
{"severity":"ERROR","time":"2022-08-23T01:16:16.778Z","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:74:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:5d69d69501ead76bbc5e545f1bcbdd0d,jid:4c8bfc38e7d819f378533cfc,endpoint_id:Ci::DeleteObjectsWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"continuous_integration","tags.correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","extra.sidekiq":{"retry":0,"queue":"ci_delete_objects","version":0,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4c8bfc38e7d819f378533cfc","created_at":1661217375.859826,"enqueued_at":1661217375.907668,"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","size_limiter":"validated"}}
{"severity":"ERROR","time":"2022-08-23T01:16:16.806Z","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:74:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:5d69d69501ead76bbc5e545f1bcbdd0d,jid:f95d25d3ea343e914a9b0f8f,endpoint_id:Ci::DeleteObjectsWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"continuous_integration","tags.correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","extra.sidekiq":{"retry":0,"queue":"ci_delete_objects","version":0,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f95d25d3ea343e914a9b0f8f","created_at":1661217375.859826,"enqueued_at":1661217375.907668,"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","size_limiter":"validated"}}
{"severity":"ERROR","time":"2022-08-23T01:16:16.836Z","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:74:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:5d69d69501ead76bbc5e545f1bcbdd0d,jid:b01c71324d301a91626de8ce,endpoint_id:Ci::DeleteObjectsWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"continuous_integration","tags.correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","extra.sidekiq":{"retry":0,"queue":"ci_delete_objects","version":0,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b01c71324d301a91626de8ce","created_at":1661217375.859826,"enqueued_at":1661217375.907668,"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","size_limiter":"validated"}}
{"severity":"ERROR","time":"2022-08-23T01:16:16.923Z","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:74:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:5d69d69501ead76bbc5e545f1bcbdd0d,jid:b7e321ff3910d34e9d759ca5,endpoint_id:Ci::DeleteObjectsWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"continuous_integration","tags.correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","extra.sidekiq":{"retry":0,"queue":"ci_delete_objects","version":0,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b7e321ff3910d34e9d759ca5","created_at":1661217375.859826,"enqueued_at":1661217375.907668,"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","size_limiter":"validated"}}
{"severity":"ERROR","time":"2022-08-23T01:16:16.944Z","correlation_id":"fde4cfff77955bbf5e6567acbe0fcc32","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:74:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:fde4cfff77955bbf5e6567acbe0fcc32,jid:e04970a8e2b8539966c0619e,endpoint_id:LooseForeignKeys::CleanupWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"pods","tags.correlation_id":"fde4cfff77955bbf5e6567acbe0fcc32","extra.sidekiq":{"retry":false,"queue":"cronjob:loose_foreign_keys_cleanup","version":0,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e04970a8e2b8539966c0619e","created_at":1661217376.3516853,"meta.caller_id":"Cronjob","correlation_id":"fde4cfff77955bbf5e6567acbe0fcc32","meta.root_caller_id":"Cronjob","meta.feature_category":"pods","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:loose_foreign_keys_cleanup:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":1661217376.3542917}}
{"severity":"ERROR","time":"2022-08-23T01:16:17.345Z","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:102:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:74:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:5d69d69501ead76bbc5e545f1bcbdd0d,jid:079e5ebcd08e81ed069d2b40,endpoint_id:Ci::DeleteObjectsWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"continuous_integration","tags.correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","extra.sidekiq":{"retry":0,"queue":"ci_delete_objects","version":0,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"079e5ebcd08e81ed069d2b40","created_at":1661217375.859826,"enqueued_at":1661217375.907668,"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5d69d69501ead76bbc5e545f1bcbdd0d","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","size_limiter":"validated"}}
{"severity":"ERROR","time":"2022-08-23T01:45:08.503Z","correlation_id":"b0fa8b67a52323533f9b723400640575","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:76:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:103:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:103:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:b0fa8b67a52323533f9b723400640575,jid:acd3aca61cdf48d73f6521bb,endpoint_id:PagesDomainVerificationCronWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"pages","tags.correlation_id":"b0fa8b67a52323533f9b723400640575","extra.sidekiq":{"retry":false,"queue":"cronjob:pages_domain_verification_cron","version":0,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"acd3aca61cdf48d73f6521bb","created_at":1661219108.2206252,"meta.caller_id":"Cronjob","correlation_id":"b0fa8b67a52323533f9b723400640575","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:pages_domain_verification_cron:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":1661219108.2290652}}
{"severity":"ERROR","time":"2022-08-23T01:45:08.743Z","correlation_id":"819f60fc2bc50defc403a60dd40ad180","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:76:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:103:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:103:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:819f60fc2bc50defc403a60dd40ad180,jid:7e64af9ff975475b0e2fc7df,endpoint_id:Database::BatchedBackgroundMigration::CiDatabaseWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"database","tags.correlation_id":"819f60fc2bc50defc403a60dd40ad180","extra.sidekiq":{"retry":false,"queue":"cronjob:database_batched_background_migration_ci_database","version":0,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7e64af9ff975475b0e2fc7df","created_at":1661219108.2763543,"meta.caller_id":"Cronjob","correlation_id":"819f60fc2bc50defc403a60dd40ad180","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:database_batched_background_migration_ci_database:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":1661219108.321784}}
{"severity":"ERROR","time":"2022-08-23T01:45:08.759Z","correlation_id":"07ec306511277ccbe3dc84b7065fad5b","exception.class":"ActiveRecord::StatementInvalid","exception.message":"PG::InvalidParameterValue: ERROR:  invalid value for parameter \"TimeZone\": \"UTC\"\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:9:in `call'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:10:in `block in call'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:9:in `call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:76:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:103:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:103:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:75:in `call'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'"],"exception.sql":"/*application:sidekiq,correlation_id:07ec306511277ccbe3dc84b7065fad5b,jid:f210664f7cf62aeb37ee8d6a,endpoint_id:ContainerRegistry::Migration::EnqueuerWorker,db_config_name:unknown*/ SET SESSION timezone TO $1","user.username":null,"tags.program":"sidekiq","tags.locale":"en","tags.feature_category":"container_registry","tags.correlation_id":"07ec306511277ccbe3dc84b7065fad5b","extra.sidekiq":{"retry":false,"queue":"cronjob:container_registry_migration_enqueuer","version":0,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::Migration::EnqueuerWorker","jid":"f210664f7cf62aeb37ee8d6a","created_at":1661219108.2467015,"meta.caller_id":"Cronjob","correlation_id":"07ec306511277ccbe3dc84b7065fad5b","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:container_registry_migration_enqueuer:ab8e4f6ae672f357497ee5977e24e7155aa83eef7c83ddba6548d62ca5bec3a1","size_limiter":"validated","enqueued_at":1661219108.250651}}
{"severity":"ERROR","time":"2022-08-23T02:17:04.086Z","correlation_id":"ec964803-f17d-47ff-9cb1-e9d07b23e59b","exception.class":"ActiveRecord::ConnectionNotEstablished","exception.message":"FATAL:  the database system is shutting down\n","exception.backtrace":["lib/gitlab/database/load_balancing/load_balancer.rb:112:in `block in read_write'","lib/gitlab/database/load_balancing/load_balancer.rb:184:in `retry_with_backoff'","lib/gitlab/database/load_balancing/load_balancer.rb:111:in `read_write'","lib/gitlab/database/load_balancing/connection_proxy.rb:119:in `write_using_load_balancer'","lib/gitlab/database/load_balancing/connection_proxy.rb:89:in `method_missing'","lib/gitlab/database/query_analyzers/gitlab_schemas_metrics.rb:16:in `enabled?'","lib/gitlab/database/query_analyzer.rb:49:in `block in begin!'","lib/gitlab/database/query_analyzer.rb:46:in `select'","lib/gitlab/database/query_analyzer.rb:46:in `begin!'","lib/gitlab/database/query_analyzer.rb:34:in `within'","lib/gitlab/middleware/query_analyzer.rb:11:in `call'","lib/gitlab/middleware/multipart.rb:173:in `call'","lib/gitlab/middleware/read_only/controller.rb:50:in `call'","lib/gitlab/middleware/read_only.rb:18:in `call'","lib/gitlab/middleware/same_site_cookies.rb:27:in `call'","lib/gitlab/middleware/handle_malformed_strings.rb:21:in `call'","lib/gitlab/middleware/basic_health_check.rb:25:in `call'","lib/gitlab/middleware/handle_ip_spoof_attack_error.rb:25:in `call'","lib/gitlab/middleware/request_context.rb:21:in `call'","lib/gitlab/middleware/webhook_recursion_detection.rb:15:in `call'","config/initializers/fix_local_cache_middleware.rb:11:in `call'","lib/gitlab/middleware/compressed_json.rb:26:in `call'","lib/gitlab/middleware/rack_multipart_tempfile_factory.rb:19:in `call'","lib/gitlab/middleware/sidekiq_web_static.rb:20:in `call'","lib/gitlab/metrics/requests_rack_middleware.rb:77:in `call'","lib/gitlab/middleware/release_env.rb:13:in `call'"],"user.username":null,"tags.program":"web","tags.locale":"en","tags.feature_category":null,"tags.correlation_id":"ec964803-f17d-47ff-9cb1-e9d07b23e59b"}

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2022-06-14-12-46-36.log <==
-- add_column(:application_settings, :pipeline_limit_per_project_user_sha, :integer, {:default=>0, :null=>false})
   -> 0.0071s
== 20220511191503 AddPipelineCreateLimitPerProjectUserShaToApplicationSettings: migrated (0.0072s)

== 20220513043344 RescheduleExpireOAuthTokens: migrating ======================
== 20220513043344 RescheduleExpireOAuthTokens: migrated (0.0994s) =============

== 20220517144749 RemoveVulnerabilityApprovalRules: migrating =================
== 20220517144749 RemoveVulnerabilityApprovalRules: migrated (0.0000s) ========


==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2020-03-12-11-53-34.log <==

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2022-06-14-12-26-39.log <==
   -> 0.0051s
-- execute("RESET statement_timeout")
   -> 0.0008s
== 20220413075921 UpdateIndexOnPackagesBuildInfos: migrated (0.0350s) =========

== 20220507204024 AddSeparatedCachesOptionToProjectCiSettings: migrating ======
-- add_column(:project_ci_cd_settings, :separated_caches, :boolean, {:default=>true, :null=>false})
   -> 0.0063s
== 20220507204024 AddSeparatedCachesOptionToProjectCiSettings: migrated (0.0064s)


==> /var/log/gitlab/gitlab-rails/api_json.log <==
{"time":"2022-08-23T02:32:50.120Z","severity":"INFO","duration_s":0.25625,"db_duration_s":0.06546,"view_duration_s":0.19079,"status":200,"method":"GET","path":"/api/v4/namespaces.json","params":[{"key":"per_page","value":"20"}],"host":"58.32.237.86","remote_ip":"125.35.78.118, 125.35.78.118","ua":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","route":"/api/:version/namespaces","user_id":2,"username":"jenkins","queue_duration_s":0.013783,"redis_calls":3,"redis_duration_s":0.001227,"redis_read_bytes":183,"redis_write_bytes":1264,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000779,"redis_shared_state_write_bytes":106,"redis_sessions_calls":1,"redis_sessions_duration_s":0.000448,"redis_sessions_read_bytes":183,"redis_sessions_write_bytes":1158,"db_count":25,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":25,"db_main_count":25,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_duration_s":0.069,"db_main_replica_duration_s":0.0,"cpu_s":0.229576,"mem_objects":34228,"mem_bytes":2904696,"mem_mallocs":7340,"mem_total_bytes":4273816,"pid":22137,"worker_id":"puma_1","rate_limiting_gates":[],"correlation_id":"01GB48Q7X3BHM24MVNJY79CABQ","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"GET /api/:version/namespaces","meta.remote_ip":"125.35.78.118","meta.feature_category":"subgroups","request_urgency":"low","target_duration_s":5}
{"time":"2022-08-23T02:32:57.456Z","severity":"INFO","duration_s":0.27117,"db_duration_s":0.07612,"view_duration_s":0.19505,"status":200,"method":"GET","path":"/api/v4/namespaces.json","params":[{"key":"per_page","value":"20"}],"host":"58.32.237.86","remote_ip":"125.35.78.118, 125.35.78.118","ua":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","route":"/api/:version/namespaces","user_id":2,"username":"jenkins","queue_duration_s":0.023646,"redis_calls":4,"redis_duration_s":0.008104,"redis_read_bytes":386,"redis_write_bytes":1323,"redis_cache_calls":1,"redis_cache_duration_s":0.000894,"redis_cache_read_bytes":203,"redis_cache_write_bytes":61,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000889,"redis_shared_state_write_bytes":106,"redis_sessions_calls":1,"redis_sessions_duration_s":0.006321,"redis_sessions_read_bytes":183,"redis_sessions_write_bytes":1156,"db_count":25,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":25,"db_main_count":25,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.08,"db_main_duration_s":0.08,"db_main_replica_duration_s":0.0,"cpu_s":0.239898,"mem_objects":29950,"mem_bytes":1492088,"mem_mallocs":5357,"mem_total_bytes":2690088,"pid":22137,"worker_id":"puma_1","rate_limiting_gates":[],"correlation_id":"01GB48QF1JF3XQZVDR9T1ZTMXP","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"GET /api/:version/namespaces","meta.remote_ip":"125.35.78.118","meta.feature_category":"subgroups","request_urgency":"low","target_duration_s":5}
{"time":"2022-08-23T02:33:16.068Z","severity":"INFO","duration_s":0.20818,"db_duration_s":0.05922,"view_duration_s":0.14896,"status":200,"method":"GET","path":"/api/v4/namespaces.json","params":[{"key":"per_page","value":"20"}],"host":"58.32.237.86","remote_ip":"125.35.78.118, 125.35.78.118","ua":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","route":"/api/:version/namespaces","user_id":2,"username":"jenkins","queue_duration_s":0.0122,"redis_calls":5,"redis_duration_s":0.002012,"redis_read_bytes":589,"redis_write_bytes":1371,"redis_cache_calls":2,"redis_cache_duration_s":0.000903,"redis_cache_read_bytes":406,"redis_cache_write_bytes":107,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000645,"redis_shared_state_write_bytes":106,"redis_sessions_calls":1,"redis_sessions_duration_s":0.000464,"redis_sessions_read_bytes":183,"redis_sessions_write_bytes":1158,"db_count":25,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":25,"db_main_count":25,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_duration_s":0.062,"db_main_replica_duration_s":0.0,"cpu_s":0.177708,"mem_objects":30423,"mem_bytes":1554056,"mem_mallocs":5526,"mem_total_bytes":2770976,"pid":22137,"worker_id":"puma_1","rate_limiting_gates":[],"correlation_id":"01GB48R19TREN7HV7JW9MNKD0K","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"GET /api/:version/namespaces","meta.remote_ip":"125.35.78.118","meta.feature_category":"subgroups","request_urgency":"low","target_duration_s":5}
{"time":"2022-08-23T02:45:42.759Z","severity":"INFO","duration_s":0.00593,"db_duration_s":0.0,"view_duration_s":0.00593,"status":200,"method":"GET","path":"/api/v4/internal/check","params":[],"host":"127.0.0.1","remote_ip":"127.0.0.1","ua":"GitLab-Shell","route":"/api/:version/internal/check","queue_duration_s":0.052906,"redis_calls":1,"redis_duration_s":0.001873,"redis_read_bytes":4,"redis_write_bytes":8,"redis_shared_state_calls":1,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":8,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_duration_s":0.009,"db_main_replica_duration_s":0.0,"cpu_s":0.061179,"mem_objects":9375,"mem_bytes":856862,"mem_mallocs":2323,"mem_total_bytes":1231862,"pid":22137,"worker_id":"puma_1","rate_limiting_gates":[],"correlation_id":"01GB49ETMWFJ171KETA304G8N5","meta.client_id":"ip/127.0.0.1","meta.caller_id":"GET /api/:version/internal/check","meta.remote_ip":"127.0.0.1","meta.feature_category":"not_owned","request_urgency":"default","target_duration_s":1}
{"time":"2022-08-23T03:09:17.514Z","severity":"INFO","duration_s":0.00928,"db_duration_s":0.0,"view_duration_s":0.00928,"status":401,"method":"POST","path":"/api/v4/internal/workhorse/authorize_upload","params":[],"host":"localhost","remote_ip":"109.206.241.227","ua":"python-requests/2.22.0","route":"/api/:version/internal/workhorse/authorize_upload","redis_calls":2,"redis_duration_s":0.00176,"redis_read_bytes":404,"redis_write_bytes":200,"redis_cache_calls":2,"redis_cache_duration_s":0.00176,"redis_cache_read_bytes":404,"redis_cache_write_bytes":200,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_duration_s":0.01,"db_main_replica_duration_s":0.0,"cpu_s":0.07033,"mem_objects":7334,"mem_bytes":928254,"mem_mallocs":2453,"mem_total_bytes":1221614,"pid":22137,"worker_id":"puma_1","rate_limiting_gates":[],"correlation_id":"01GB4AT07J7QKVYCTATKHGEXWZ","meta.client_id":"ip/109.206.241.227","meta.caller_id":"POST /api/:version/internal/workhorse/authorize_upload","meta.remote_ip":"109.206.241.227","meta.feature_category":"not_owned","content_length":"0","request_urgency":"default","target_duration_s":1}
{"time":"2022-08-23T03:19:03.880Z","severity":"INFO","duration_s":0.03393,"db_duration_s":0.0,"view_duration_s":0.03393,"status":401,"method":"POST","path":"/api/v4/internal/workhorse/authorize_upload","params":[],"host":"localhost","remote_ip":"51.81.85.224","ua":"Python/3.9 aiohttp/3.8.1","route":"/api/:version/internal/workhorse/authorize_upload","redis_calls":2,"redis_duration_s":0.005226,"redis_read_bytes":404,"redis_write_bytes":200,"redis_cache_calls":2,"redis_cache_duration_s":0.005226,"redis_cache_read_bytes":404,"redis_cache_write_bytes":200,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_duration_s":0.009,"db_main_replica_duration_s":0.0,"cpu_s":0.128332,"mem_objects":12984,"mem_bytes":3372294,"mem_mallocs":5865,"mem_total_bytes":3891654,"pid":22139,"worker_id":"puma_2","rate_limiting_gates":[],"correlation_id":"01GB4BBWSF7G1PVVWZZ0DCMDDH","meta.client_id":"ip/51.81.85.224","meta.caller_id":"POST /api/:version/internal/workhorse/authorize_upload","meta.remote_ip":"51.81.85.224","meta.feature_category":"not_owned","content_length":"0","request_urgency":"default","target_duration_s":1}
{"time":"2022-08-23T03:34:06.652Z","severity":"INFO","duration_s":0.01806,"db_duration_s":0.0,"view_duration_s":0.01806,"status":200,"method":"GET","path":"/api/v4/geo/proxy","params":[],"host":"localhost","remote_ip":"127.0.0.1","ua":"Go-http-client/1.1","route":"/api/:version/geo/proxy","redis_calls":2,"redis_duration_s":0.000793,"redis_read_bytes":406,"redis_write_bytes":200,"redis_cache_calls":2,"redis_cache_duration_s":0.000793,"redis_cache_read_bytes":406,"redis_cache_write_bytes":200,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_duration_s":0.004,"db_main_replica_duration_s":0.0,"cpu_s":0.058761,"mem_objects":10008,"mem_bytes":4006030,"mem_mallocs":5704,"mem_total_bytes":4406350,"pid":22135,"worker_id":"puma_0","rate_limiting_gates":[],"correlation_id":"c02350df-68e0-44ee-8dbc-b39b1367eafa","meta.client_id":"ip/127.0.0.1","meta.caller_id":"GET /api/:version/geo/proxy","meta.remote_ip":"127.0.0.1","meta.feature_category":"geo_replication","request_urgency":"low","target_duration_s":5}
{"time":"2022-08-23T05:04:49.945Z","severity":"INFO","duration_s":0.0188,"db_duration_s":0.0,"view_duration_s":0.0188,"status":200,"method":"GET","path":"/api/v4/geo/proxy","params":[],"host":"localhost","remote_ip":"127.0.0.1","ua":"Go-http-client/1.1","route":"/api/:version/geo/proxy","db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.062307,"mem_objects":8795,"mem_bytes":3560864,"mem_mallocs":4929,"mem_total_bytes":3912664,"pid":14120,"worker_id":"puma_3","rate_limiting_gates":[],"correlation_id":"a185053f-27fc-433a-a83c-f80705f7e486","meta.client_id":"ip/127.0.0.1","meta.caller_id":"GET /api/:version/geo/proxy","meta.remote_ip":"127.0.0.1","meta.feature_category":"geo_replication","request_urgency":"low","target_duration_s":5}
{"time":"2022-08-23T05:22:27.385Z","severity":"INFO","duration_s":0.01866,"db_duration_s":0.0,"view_duration_s":0.01866,"status":200,"method":"GET","path":"/api/v4/geo/proxy","params":[],"host":"localhost","remote_ip":"127.0.0.1","ua":"Go-http-client/1.1","route":"/api/:version/geo/proxy","db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.045226,"mem_objects":6689,"mem_bytes":3378632,"mem_mallocs":4485,"mem_total_bytes":3646192,"pid":17588,"worker_id":"puma_0","rate_limiting_gates":[],"correlation_id":"9e3e2d6d-1f27-418b-922c-2d878e47fedb","meta.client_id":"ip/127.0.0.1","meta.caller_id":"GET /api/:version/geo/proxy","meta.remote_ip":"127.0.0.1","meta.feature_category":"geo_replication","request_urgency":"low","target_duration_s":5}
{"time":"2022-08-23T05:23:25.591Z","severity":"INFO","duration_s":0.01826,"db_duration_s":0.0,"view_duration_s":0.01826,"status":200,"method":"GET","path":"/api/v4/internal/check","params":[],"host":"127.0.0.1","remote_ip":"127.0.0.1","ua":"GitLab-Shell","route":"/api/:version/internal/check","queue_duration_s":0.006586,"redis_calls":1,"redis_duration_s":0.000427,"redis_read_bytes":4,"redis_write_bytes":4,"redis_shared_state_calls":1,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":4,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.042402,"mem_objects":7880,"mem_bytes":3424408,"mem_mallocs":4504,"mem_total_bytes":3739608,"pid":17593,"worker_id":"puma_3","rate_limiting_gates":[],"correlation_id":"01GB4JFKQ91CZFKVH7SSXAJWAK","meta.client_id":"ip/127.0.0.1","meta.caller_id":"GET /api/:version/internal/check","meta.remote_ip":"127.0.0.1","meta.feature_category":"not_owned","request_urgency":"default","target_duration_s":1}

==> /var/log/gitlab/gitlab-rails/grpc.log <==

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2020-04-02-08-38-02.log <==

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2020-04-27-09-17-01.log <==

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2020-03-02-11-53-38.log <==

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2021-06-09-10-54-30.log <==
   -> 0.0006s
-- add_index(:users, :require_two_factor_authentication_from_group, {:where=>"require_two_factor_authentication_from_group = FALSE", :name=>"index_users_require_two_factor_authentication_from_group_false", :algorithm=>:concurrently})
   -> 0.0102s
-- execute("RESET ALL")
   -> 0.0006s
-- Scheduled 1 UpdateUsersWhereTwoFactorAuthRequiredFromGroup jobs with a maximum of 10000 records per batch and an interval of 120 seconds.

The migration is expected to take at least 120 seconds. Expect all jobs to have completed after 2021-06-09 02:58:06 UTC."
== 20210519154058 ScheduleUpdateUsersWhereTwoFactorAuthRequiredFromGroup: migrated (0.3426s)


==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2022-06-14-11-35-11.log <==
   -> 0.0115s
-- execute("RESET statement_timeout")
   -> 0.0007s
== 20220314162342 AddIndexCiJobArtifactsProjectIdCreatedAt: migrated (0.0372s)

== 20220314194149 AddProjectCiSecureFilesToPlanLimits: migrating ==============
-- add_column(:plan_limits, :project_ci_secure_files, :integer, {:default=>100, :null=>false})
   -> 0.0032s
== 20220314194149 AddProjectCiSecureFilesToPlanLimits: migrated (0.0033s) =====


==> /var/log/gitlab/gitlab-rails/application.log <==
2022-08-23T06:21:13.578Z: {:message=>"Checking state of dynamic postgres partitions", :table_name=>"incident_management_pending_alert_escalations", :connection_name=>"main"}
2022-08-23T06:21:13.608Z: {:message=>"Switched database connection", :connection_name=>"main"}
2022-08-23T06:21:13.608Z: {:message=>"Checking state of dynamic postgres partitions", :table_name=>"incident_management_pending_issue_escalations", :connection_name=>"main"}
2022-08-23T06:21:13.638Z: {:message=>"Switched database connection", :connection_name=>"main"}
2022-08-23T06:21:13.639Z: {:message=>"Checking state of dynamic postgres partitions", :table_name=>"verification_codes", :connection_name=>"main"}
2022-08-23T06:21:13.669Z: {:message=>"Finished sync of dynamic postgres partitions"}
2022-08-23T06:21:13.669Z: {:message=>"Switched database connection", :connection_name=>"main"}
2022-08-23T06:21:13.705Z: {:message=>"Switched database connection", :connection_name=>"main"}
2022-08-23T06:21:13.721Z: {:message=>"Switched database connection", :connection_name=>"main"}
2022-08-23T06:21:13.736Z: {:message=>"Switched database connection", :connection_name=>"main"}

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2019-11-29-08-25-19.log <==

==> /var/log/gitlab/gitlab-rails/graphql_json.log <==
{"severity":"INFO","time":"2022-08-22T08:19:57.739Z","correlation_id":"01GB2A64J716V9HMSYG5QZPVQX","trace_type":"execute_query","query_fingerprint":"getPaginatedTree/YeUMfC7PCrEzxrjrAoYeOfnbhcyDgys272dXorm79Jw=/5/pEyPJAq9M9iTBzkAL66TQExvCZ2L72M9WAPQ9VX0HHo=","duration_s":0.0011869029985973611,"operation_name":"getPaginatedTree","operation_fingerprint":"getPaginatedTree/YeUMfC7PCrEzxrjrAoYeOfnbhcyDgys272dXorm79Jw=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\", \"ref\"=\u003e\"HGI16-UI-develop\", \"path\"=\u003e\"/\", \"nextPageCursor\"=\u003e\"\", \"pageSize\"=\u003e100}","query_string":"fragment TreeEntry on Entry {\n  __typename\n  id\n  sha\n  name\n  flatPath\n  type\n}\n\nquery getPaginatedTree($projectPath: ID!, $path: String, $ref: String!, $nextPageCursor: String) {\n  project(fullPath: $projectPath) {\n    id\n    __typename\n    repository {\n      __typename\n      paginatedTree(path: $path, ref: $ref, after: $nextPageCursor) {\n        __typename\n        pageInfo {\n          __typename\n          endCursor\n          startCursor\n          hasNextPage\n        }\n        nodes {\n          __typename\n          trees {\n            __typename\n            nodes {\n              ...TreeEntry\n              webPath\n              __typename\n            }\n          }\n          submodules {\n            __typename\n            nodes {\n              ...TreeEntry\n              webUrl\n              treeUrl\n              __typename\n            }\n          }\n          blobs {\n            __typename\n            nodes {\n              ...TreeEntry\n              mode\n              webPath\n              lfsOid\n              __typename\n            }\n          }\n        }\n      }\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:getPaginatedTree","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.016424115005065687,"query_analysis.depth":7,"query_analysis.complexity":51,"query_analysis.used_fields":["Project.id","Project.__typename","Repository.__typename","TreeConnection.__typename","PageInfo.__typename","PageInfo.endCursor","PageInfo.startCursor","PageInfo.hasNextPage","TreeConnection.pageInfo","Tree.__typename","TreeEntryConnection.__typename","Entry.__typename","Entry.id","Entry.sha","Entry.name","Entry.flatPath","Entry.type","TreeEntry.webPath","TreeEntry.__typename","TreeEntryConnection.nodes","Tree.trees","SubmoduleConnection.__typename","Submodule.webUrl","Submodule.treeUrl","Submodule.__typename","SubmoduleConnection.nodes","Tree.submodules","BlobConnection.__typename","Blob.mode","Blob.webPath","Blob.lfsOid","Blob.__typename","BlobConnection.nodes","Tree.blobs","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T00:19:36.202Z","correlation_id":"01GB4139HGAT32VB7M8YFKABV6","trace_type":"execute_query","query_fingerprint":"pathLastCommit/A76CS_Lr2wc3swMokIjsFgxxi0F0m64vhTXxiqc5XbA=/3/8q5mtw5EFQ99C5FEMc8C0xGwPPC839dCp8t-56AxlRI=","duration_s":0.005191953998291865,"operation_name":"pathLastCommit","operation_fingerprint":"pathLastCommit/A76CS_Lr2wc3swMokIjsFgxxi0F0m64vhTXxiqc5XbA=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\", \"ref\"=\u003e\"HGI16-UI-develop\", \"path\"=\u003e\"\"}","query_string":"query pathLastCommit($projectPath: ID!, $path: String, $ref: String!) {\n  project(fullPath: $projectPath) {\n    __typename\n    id\n    repository {\n      __typename\n      paginatedTree(path: $path, ref: $ref) {\n        __typename\n        nodes {\n          __typename\n          lastCommit {\n            __typename\n            id\n            sha\n            title\n            titleHtml\n            descriptionHtml\n            message\n            webPath\n            authoredDate\n            authorName\n            authorGravatar\n            author {\n              __typename\n              id\n              name\n              avatarUrl\n              webPath\n            }\n            signatureHtml\n            pipelines(ref: $ref, first: 1) {\n              __typename\n              edges {\n                __typename\n                node {\n                  __typename\n                  id\n                  detailedStatus {\n                    __typename\n                    id\n                    detailsPath\n                    icon\n                    tooltip\n                    text\n                    group\n                  }\n                }\n              }\n            }\n          }\n        }\n      }\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:pathLastCommit","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.00925289498991333,"query_analysis.depth":10,"query_analysis.complexity":65,"query_analysis.used_fields":["Project.__typename","Project.id","Repository.__typename","TreeConnection.__typename","Tree.__typename","Commit.__typename","Commit.id","Commit.sha","Commit.title","Commit.titleHtml","Commit.descriptionHtml","Commit.message","Commit.webPath","Commit.authoredDate","Commit.authorName","Commit.authorGravatar","UserCore.__typename","UserCore.id","UserCore.name","UserCore.avatarUrl","UserCore.webPath","Commit.author","Commit.signatureHtml","PipelineConnection.__typename","PipelineEdge.__typename","Pipeline.__typename","Pipeline.id","DetailedStatus.__typename","DetailedStatus.id","DetailedStatus.detailsPath","DetailedStatus.icon","DetailedStatus.tooltip","DetailedStatus.text","DetailedStatus.group","Pipeline.detailedStatus","PipelineEdge.node","PipelineConnection.edges","Commit.pipelines","Tree.lastCommit","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T00:19:36.760Z","correlation_id":"01GB413A2W8Z7PB2KTSP9QVC20","trace_type":"execute_query","query_fingerprint":"pathLastCommit/A76CS_Lr2wc3swMokIjsFgxxi0F0m64vhTXxiqc5XbA=/3/8q5mtw5EFQ99C5FEMc8C0xGwPPC839dCp8t-56AxlRI=","duration_s":0.0015521350142080337,"operation_name":"pathLastCommit","operation_fingerprint":"pathLastCommit/A76CS_Lr2wc3swMokIjsFgxxi0F0m64vhTXxiqc5XbA=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\", \"ref\"=\u003e\"HGI16-UI-develop\", \"path\"=\u003e\"\"}","query_string":"query pathLastCommit($projectPath: ID!, $path: String, $ref: String!) {\n  project(fullPath: $projectPath) {\n    __typename\n    id\n    repository {\n      __typename\n      paginatedTree(path: $path, ref: $ref) {\n        __typename\n        nodes {\n          __typename\n          lastCommit {\n            __typename\n            id\n            sha\n            title\n            titleHtml\n            descriptionHtml\n            message\n            webPath\n            authoredDate\n            authorName\n            authorGravatar\n            author {\n              __typename\n              id\n              name\n              avatarUrl\n              webPath\n            }\n            signatureHtml\n            pipelines(ref: $ref, first: 1) {\n              __typename\n              edges {\n                __typename\n                node {\n                  __typename\n                  id\n                  detailedStatus {\n                    __typename\n                    id\n                    detailsPath\n                    icon\n                    tooltip\n                    text\n                    group\n                  }\n                }\n              }\n            }\n          }\n        }\n      }\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:pathLastCommit","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.014847403013845906,"query_analysis.depth":10,"query_analysis.complexity":65,"query_analysis.used_fields":["Project.__typename","Project.id","Repository.__typename","TreeConnection.__typename","Tree.__typename","Commit.__typename","Commit.id","Commit.sha","Commit.title","Commit.titleHtml","Commit.descriptionHtml","Commit.message","Commit.webPath","Commit.authoredDate","Commit.authorName","Commit.authorGravatar","UserCore.__typename","UserCore.id","UserCore.name","UserCore.avatarUrl","UserCore.webPath","Commit.author","Commit.signatureHtml","PipelineConnection.__typename","PipelineEdge.__typename","Pipeline.__typename","Pipeline.id","DetailedStatus.__typename","DetailedStatus.id","DetailedStatus.detailsPath","DetailedStatus.icon","DetailedStatus.tooltip","DetailedStatus.text","DetailedStatus.group","Pipeline.detailedStatus","PipelineEdge.node","PipelineConnection.edges","Commit.pipelines","Tree.lastCommit","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T00:19:36.820Z","correlation_id":"01GB413A3HHS5F7XF64Y4F2VMM","trace_type":"execute_query","query_fingerprint":"getPermissions/pobGa1BJiZuXZrZu0uBGcJQ__bJl2MwgE5hau04CbQ8=/1/MAccSzoemKfsKstaLRGGW7NYtcyLa-pR7tCgDI4qq4A=","duration_s":0.008279238973045722,"operation_name":"getPermissions","operation_fingerprint":"getPermissions/pobGa1BJiZuXZrZu0uBGcJQ__bJl2MwgE5hau04CbQ8=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\"}","query_string":"query getPermissions($projectPath: ID!) {\n  project(fullPath: $projectPath) {\n    id\n    __typename\n    userPermissions {\n      __typename\n      pushCode\n      forkProject\n      createMergeRequestIn\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:getPermissions","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.014317080000182614,"query_analysis.depth":7,"query_analysis.complexity":51,"query_analysis.used_fields":["Project.id","Project.__typename","Repository.__typename","TreeConnection.__typename","PageInfo.__typename","PageInfo.endCursor","PageInfo.startCursor","PageInfo.hasNextPage","TreeConnection.pageInfo","Tree.__typename","TreeEntryConnection.__typename","Entry.__typename","Entry.id","Entry.sha","Entry.name","Entry.flatPath","Entry.type","TreeEntry.webPath","TreeEntry.__typename","TreeEntryConnection.nodes","Tree.trees","SubmoduleConnection.__typename","Submodule.webUrl","Submodule.treeUrl","Submodule.__typename","SubmoduleConnection.nodes","Tree.submodules","BlobConnection.__typename","Blob.mode","Blob.webPath","Blob.lfsOid","Blob.__typename","BlobConnection.nodes","Tree.blobs","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T00:19:36.824Z","correlation_id":"01GB413A3HHS5F7XF64Y4F2VMM","trace_type":"execute_query","query_fingerprint":"getPaginatedTree/YeUMfC7PCrEzxrjrAoYeOfnbhcyDgys272dXorm79Jw=/5/pEyPJAq9M9iTBzkAL66TQExvCZ2L72M9WAPQ9VX0HHo=","duration_s":0.001201183011289686,"operation_name":"getPaginatedTree","operation_fingerprint":"getPaginatedTree/YeUMfC7PCrEzxrjrAoYeOfnbhcyDgys272dXorm79Jw=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\", \"ref\"=\u003e\"HGI16-UI-develop\", \"path\"=\u003e\"/\", \"nextPageCursor\"=\u003e\"\", \"pageSize\"=\u003e100}","query_string":"fragment TreeEntry on Entry {\n  __typename\n  id\n  sha\n  name\n  flatPath\n  type\n}\n\nquery getPaginatedTree($projectPath: ID!, $path: String, $ref: String!, $nextPageCursor: String) {\n  project(fullPath: $projectPath) {\n    id\n    __typename\n    repository {\n      __typename\n      paginatedTree(path: $path, ref: $ref, after: $nextPageCursor) {\n        __typename\n        pageInfo {\n          __typename\n          endCursor\n          startCursor\n          hasNextPage\n        }\n        nodes {\n          __typename\n          trees {\n            __typename\n            nodes {\n              ...TreeEntry\n              webPath\n              __typename\n            }\n          }\n          submodules {\n            __typename\n            nodes {\n              ...TreeEntry\n              webUrl\n              treeUrl\n              __typename\n            }\n          }\n          blobs {\n            __typename\n            nodes {\n              ...TreeEntry\n              mode\n              webPath\n              lfsOid\n              __typename\n            }\n          }\n        }\n      }\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:getPaginatedTree","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.014317080000182614,"query_analysis.depth":7,"query_analysis.complexity":51,"query_analysis.used_fields":["Project.id","Project.__typename","Repository.__typename","TreeConnection.__typename","PageInfo.__typename","PageInfo.endCursor","PageInfo.startCursor","PageInfo.hasNextPage","TreeConnection.pageInfo","Tree.__typename","TreeEntryConnection.__typename","Entry.__typename","Entry.id","Entry.sha","Entry.name","Entry.flatPath","Entry.type","TreeEntry.webPath","TreeEntry.__typename","TreeEntryConnection.nodes","Tree.trees","SubmoduleConnection.__typename","Submodule.webUrl","Submodule.treeUrl","Submodule.__typename","SubmoduleConnection.nodes","Tree.submodules","BlobConnection.__typename","Blob.mode","Blob.webPath","Blob.lfsOid","Blob.__typename","BlobConnection.nodes","Tree.blobs","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T00:48:27.863Z","correlation_id":"01GB42R4H25MPCJJSD37TCVAM3","trace_type":"execute_query","query_fingerprint":"getPermissions/pobGa1BJiZuXZrZu0uBGcJQ__bJl2MwgE5hau04CbQ8=/1/MAccSzoemKfsKstaLRGGW7NYtcyLa-pR7tCgDI4qq4A=","duration_s":0.007722776994341984,"operation_name":"getPermissions","operation_fingerprint":"getPermissions/pobGa1BJiZuXZrZu0uBGcJQ__bJl2MwgE5hau04CbQ8=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\"}","query_string":"query getPermissions($projectPath: ID!) {\n  project(fullPath: $projectPath) {\n    id\n    __typename\n    userPermissions {\n      __typename\n      pushCode\n      forkProject\n      createMergeRequestIn\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:getPermissions","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.013785616989480332,"query_analysis.depth":7,"query_analysis.complexity":51,"query_analysis.used_fields":["Project.id","Project.__typename","Repository.__typename","TreeConnection.__typename","PageInfo.__typename","PageInfo.endCursor","PageInfo.startCursor","PageInfo.hasNextPage","TreeConnection.pageInfo","Tree.__typename","TreeEntryConnection.__typename","Entry.__typename","Entry.id","Entry.sha","Entry.name","Entry.flatPath","Entry.type","TreeEntry.webPath","TreeEntry.__typename","TreeEntryConnection.nodes","Tree.trees","SubmoduleConnection.__typename","Submodule.webUrl","Submodule.treeUrl","Submodule.__typename","SubmoduleConnection.nodes","Tree.submodules","BlobConnection.__typename","Blob.mode","Blob.webPath","Blob.lfsOid","Blob.__typename","BlobConnection.nodes","Tree.blobs","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T00:48:27.866Z","correlation_id":"01GB42R4H25MPCJJSD37TCVAM3","trace_type":"execute_query","query_fingerprint":"getPaginatedTree/YeUMfC7PCrEzxrjrAoYeOfnbhcyDgys272dXorm79Jw=/5/pEyPJAq9M9iTBzkAL66TQExvCZ2L72M9WAPQ9VX0HHo=","duration_s":0.0010636090009938926,"operation_name":"getPaginatedTree","operation_fingerprint":"getPaginatedTree/YeUMfC7PCrEzxrjrAoYeOfnbhcyDgys272dXorm79Jw=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\", \"ref\"=\u003e\"HGI16-UI-develop\", \"path\"=\u003e\"/\", \"nextPageCursor\"=\u003e\"\", \"pageSize\"=\u003e100}","query_string":"fragment TreeEntry on Entry {\n  __typename\n  id\n  sha\n  name\n  flatPath\n  type\n}\n\nquery getPaginatedTree($projectPath: ID!, $path: String, $ref: String!, $nextPageCursor: String) {\n  project(fullPath: $projectPath) {\n    id\n    __typename\n    repository {\n      __typename\n      paginatedTree(path: $path, ref: $ref, after: $nextPageCursor) {\n        __typename\n        pageInfo {\n          __typename\n          endCursor\n          startCursor\n          hasNextPage\n        }\n        nodes {\n          __typename\n          trees {\n            __typename\n            nodes {\n              ...TreeEntry\n              webPath\n              __typename\n            }\n          }\n          submodules {\n            __typename\n            nodes {\n              ...TreeEntry\n              webUrl\n              treeUrl\n              __typename\n            }\n          }\n          blobs {\n            __typename\n            nodes {\n              ...TreeEntry\n              mode\n              webPath\n              lfsOid\n              __typename\n            }\n          }\n        }\n      }\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:getPaginatedTree","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.013785616989480332,"query_analysis.depth":7,"query_analysis.complexity":51,"query_analysis.used_fields":["Project.id","Project.__typename","Repository.__typename","TreeConnection.__typename","PageInfo.__typename","PageInfo.endCursor","PageInfo.startCursor","PageInfo.hasNextPage","TreeConnection.pageInfo","Tree.__typename","TreeEntryConnection.__typename","Entry.__typename","Entry.id","Entry.sha","Entry.name","Entry.flatPath","Entry.type","TreeEntry.webPath","TreeEntry.__typename","TreeEntryConnection.nodes","Tree.trees","SubmoduleConnection.__typename","Submodule.webUrl","Submodule.treeUrl","Submodule.__typename","SubmoduleConnection.nodes","Tree.submodules","BlobConnection.__typename","Blob.mode","Blob.webPath","Blob.lfsOid","Blob.__typename","BlobConnection.nodes","Tree.blobs","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T00:48:28.154Z","correlation_id":"01GB42R45JW8HZEAPDS8WA5DPQ","trace_type":"execute_query","query_fingerprint":"pathLastCommit/A76CS_Lr2wc3swMokIjsFgxxi0F0m64vhTXxiqc5XbA=/3/8q5mtw5EFQ99C5FEMc8C0xGwPPC839dCp8t-56AxlRI=","duration_s":0.008100979001028463,"operation_name":"pathLastCommit","operation_fingerprint":"pathLastCommit/A76CS_Lr2wc3swMokIjsFgxxi0F0m64vhTXxiqc5XbA=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\", \"ref\"=\u003e\"HGI16-UI-develop\", \"path\"=\u003e\"\"}","query_string":"query pathLastCommit($projectPath: ID!, $path: String, $ref: String!) {\n  project(fullPath: $projectPath) {\n    __typename\n    id\n    repository {\n      __typename\n      paginatedTree(path: $path, ref: $ref) {\n        __typename\n        nodes {\n          __typename\n          lastCommit {\n            __typename\n            id\n            sha\n            title\n            titleHtml\n            descriptionHtml\n            message\n            webPath\n            authoredDate\n            authorName\n            authorGravatar\n            author {\n              __typename\n              id\n              name\n              avatarUrl\n              webPath\n            }\n            signatureHtml\n            pipelines(ref: $ref, first: 1) {\n              __typename\n              edges {\n                __typename\n                node {\n                  __typename\n                  id\n                  detailedStatus {\n                    __typename\n                    id\n                    detailsPath\n                    icon\n                    tooltip\n                    text\n                    group\n                  }\n                }\n              }\n            }\n          }\n        }\n      }\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:pathLastCommit","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.01599519301089458,"query_analysis.depth":10,"query_analysis.complexity":65,"query_analysis.used_fields":["Project.__typename","Project.id","Repository.__typename","TreeConnection.__typename","Tree.__typename","Commit.__typename","Commit.id","Commit.sha","Commit.title","Commit.titleHtml","Commit.descriptionHtml","Commit.message","Commit.webPath","Commit.authoredDate","Commit.authorName","Commit.authorGravatar","UserCore.__typename","UserCore.id","UserCore.name","UserCore.avatarUrl","UserCore.webPath","Commit.author","Commit.signatureHtml","PipelineConnection.__typename","PipelineEdge.__typename","Pipeline.__typename","Pipeline.id","DetailedStatus.__typename","DetailedStatus.id","DetailedStatus.detailsPath","DetailedStatus.icon","DetailedStatus.tooltip","DetailedStatus.text","DetailedStatus.group","Pipeline.detailedStatus","PipelineEdge.node","PipelineConnection.edges","Commit.pipelines","Tree.lastCommit","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T00:48:28.880Z","correlation_id":"01GB42R5JR91S2RNACEDST2AGS","trace_type":"execute_query","query_fingerprint":"pathLastCommit/A76CS_Lr2wc3swMokIjsFgxxi0F0m64vhTXxiqc5XbA=/3/8q5mtw5EFQ99C5FEMc8C0xGwPPC839dCp8t-56AxlRI=","duration_s":0.008902911999030039,"operation_name":"pathLastCommit","operation_fingerprint":"pathLastCommit/A76CS_Lr2wc3swMokIjsFgxxi0F0m64vhTXxiqc5XbA=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\", \"ref\"=\u003e\"HGI16-UI-develop\", \"path\"=\u003e\"\"}","query_string":"query pathLastCommit($projectPath: ID!, $path: String, $ref: String!) {\n  project(fullPath: $projectPath) {\n    __typename\n    id\n    repository {\n      __typename\n      paginatedTree(path: $path, ref: $ref) {\n        __typename\n        nodes {\n          __typename\n          lastCommit {\n            __typename\n            id\n            sha\n            title\n            titleHtml\n            descriptionHtml\n            message\n            webPath\n            authoredDate\n            authorName\n            authorGravatar\n            author {\n              __typename\n              id\n              name\n              avatarUrl\n              webPath\n            }\n            signatureHtml\n            pipelines(ref: $ref, first: 1) {\n              __typename\n              edges {\n                __typename\n                node {\n                  __typename\n                  id\n                  detailedStatus {\n                    __typename\n                    id\n                    detailsPath\n                    icon\n                    tooltip\n                    text\n                    group\n                  }\n                }\n              }\n            }\n          }\n        }\n      }\n    }\n  }\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:pathLastCommit","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","query_analysis.duration_s":0.01871726699755527,"query_analysis.depth":10,"query_analysis.complexity":65,"query_analysis.used_fields":["Project.__typename","Project.id","Repository.__typename","TreeConnection.__typename","Tree.__typename","Commit.__typename","Commit.id","Commit.sha","Commit.title","Commit.titleHtml","Commit.descriptionHtml","Commit.message","Commit.webPath","Commit.authoredDate","Commit.authorName","Commit.authorGravatar","UserCore.__typename","UserCore.id","UserCore.name","UserCore.avatarUrl","UserCore.webPath","Commit.author","Commit.signatureHtml","PipelineConnection.__typename","PipelineEdge.__typename","Pipeline.__typename","Pipeline.id","DetailedStatus.__typename","DetailedStatus.id","DetailedStatus.detailsPath","DetailedStatus.icon","DetailedStatus.tooltip","DetailedStatus.text","DetailedStatus.group","Pipeline.detailedStatus","PipelineEdge.node","PipelineConnection.edges","Commit.pipelines","Tree.lastCommit","TreeConnection.nodes","Repository.paginatedTree","Project.repository","Query.project"],"query_analysis.used_deprecated_fields":[]}
{"severity":"INFO","time":"2022-08-23T02:16:53.420Z","correlation_id":"01GB47T1S43VP6NZ3HN1W0V315","trace_type":"execute_query","query_fingerprint":"getIntegrations/VDPoGKAvG42z7MlPCm8Qhx4nyNEDOz08pfo7Dr979H8=/1/MAccSzoemKfsKstaLRGGW7NYtcyLa-pR7tCgDI4qq4A=","duration_s":0.009621589997550473,"operation_name":"getIntegrations","operation_fingerprint":"getIntegrations/VDPoGKAvG42z7MlPCm8Qhx4nyNEDOz08pfo7Dr979H8=","is_mutation":false,"variables":"{\"projectPath\"=\u003e\"globalip/ui/is\"}","query_string":"query getIntegrations($projectPath: ID!) {\n  project(fullPath: $projectPath) {\n    id\n    alertManagementIntegrations {\n      nodes {\n        __typename\n        ...IntegrationItem\n      }\n      __typename\n    }\n    __typename\n  }\n}\n\nfragment IntegrationItem on AlertManagementIntegration {\n  id\n  type\n  active\n  name\n  url\n  token\n  apiUrl\n  __typename\n}\n","meta.user":"jenkins","meta.client_id":"user/2","meta.caller_id":"graphql:getIntegrations","meta.remote_ip":"125.35.78.118","meta.feature_category":"incident_management","query_analysis.duration_s":0.010506047023227438,"query_analysis.depth":4,"query_analysis.complexity":25,"query_analysis.used_fields":["Project.id","AlertManagementIntegration.__typename","AlertManagementIntegration.id","AlertManagementIntegration.type","AlertManagementIntegration.active","AlertManagementIntegration.name","AlertManagementIntegration.url","AlertManagementIntegration.token","AlertManagementIntegration.apiUrl","AlertManagementIntegrationConnection.nodes","AlertManagementIntegrationConnection.__typename","Project.alertManagementIntegrations","Project.__typename","Query.project"],"query_analysis.used_deprecated_fields":[]}

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2022-08-15-15-43-32.log <==
main: == 20220715054506 AddParentLinkUniqueWorkItemIndex: migrated (0.0540s) ========

main: == 20220715160023 DropPostMigrationTestTable: migrating =======================
main: -- drop_table(:post_migration_test_table)
main:    -> 0.0037s
main: == 20220715160023 DropPostMigrationTestTable: migrated (0.0041s) ==============

main: == 20220715163254 UpdateNotesInPast: migrating ================================
main: == 20220715163254 UpdateNotesInPast: migrated (0.0113s) =======================


==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2020-04-27-08-56-28.log <==

==> /var/log/gitlab/gitlab-rails/service_measurement.log <==
# Logfile created on 2021-06-09 10:23:53 +0800 by logger.rb/66358

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2022-06-20-08-09-56.log <==

==> /var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-2021-07-27-11-20-59.log <==
   -> 0.0012s
-- change_column_default(:vulnerabilities, :detected_at, #)
   -> 0.0085s
== 20210714120600 AddDetectedAtToVulnerabilities: migrated (0.0141s) ==========

== 20210716074555 RevertDefaultJobTokenScope: migrating =======================
-- change_column_default(:project_ci_cd_settings, :job_token_scope_enabled, {:from=>true, :to=>false})
   -> 0.0053s
== 20210716074555 RevertDefaultJobTokenScope: migrated (0.0096s) ==============


==> /var/log/gitlab/redis/current <==
2022-08-23_06:26:37.09404 17369:M 23 Aug 2022 14:26:37.093 * 10 changes in 300 seconds. Saving...
2022-08-23_06:26:37.09504 17369:M 23 Aug 2022 14:26:37.094 * Background saving started by pid 30229
2022-08-23_06:26:37.15005 30229:C 23 Aug 2022 14:26:37.149 * DB saved on disk
2022-08-23_06:26:37.15151 30229:C 23 Aug 2022 14:26:37.151 * RDB: 2 MB of memory used by copy-on-write
2022-08-23_06:26:37.19600 17369:M 23 Aug 2022 14:26:37.195 * Background saving terminated with success
2022-08-23_06:31:38.03084 17369:M 23 Aug 2022 14:31:38.030 * 10 changes in 300 seconds. Saving...
2022-08-23_06:31:38.03215 17369:M 23 Aug 2022 14:31:38.032 * Background saving started by pid 31261
2022-08-23_06:31:38.08286 31261:C 23 Aug 2022 14:31:38.082 * DB saved on disk
2022-08-23_06:31:38.08437 31261:C 23 Aug 2022 14:31:38.084 * RDB: 2 MB of memory used by copy-on-write
2022-08-23_06:31:38.13354 17369:M 23 Aug 2022 14:31:38.133 * Background saving terminated with success

==> /var/log/gitlab/redis/state <==

==> /var/log/gitlab/grafana/current <==
2022-08-23_05:21:17.72606 {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2022-08-23T13:21:17.726040+08:00","queryType":"arrow"}
2022-08-23_05:21:17.72607 {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2022-08-23T13:21:17.726054+08:00","queryType":"annotations"}
2022-08-23_05:21:17.72609 {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2022-08-23T13:21:17.726067+08:00","queryType":"table_static"}
2022-08-23_05:21:17.72610 {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2022-08-23T13:21:17.726080+08:00","queryType":"random_walk_with_error"}
2022-08-23_05:21:17.72610 {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2022-08-23T13:21:17.726094+08:00","queryType":"server_error_500"}
2022-08-23_05:21:17.72612 {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2022-08-23T13:21:17.726106+08:00","queryType":"logs"}
2022-08-23_05:21:17.72613 {"@level":"debug","@message":"datasource: registering query type handler","@timestamp":"2022-08-23T13:21:17.726119+08:00","queryType":"node_graph"}
2022-08-23_05:21:17.72615 {"@level":"debug","@message":"datasource: registering query type fallback handler","@timestamp":"2022-08-23T13:21:17.726132+08:00"}
2022-08-23_05:21:17.81183 t=2022-08-23T13:21:17+0800 lvl=eror msg="Failed to read plugin provisioning files from directory" logger=provisioning.plugins path=/var/opt/gitlab/grafana/provisioning/plugins error="open /var/opt/gitlab/grafana/provisioning/plugins: no such file or directory"
2022-08-23_05:21:17.81548 t=2022-08-23T13:21:17+0800 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3300 protocol=http subUrl=/-/grafana socket=

==> /var/log/gitlab/grafana/state <==

==> /var/log/gitlab/alertmanager/current <==
2022-08-23_05:21:14.66776 level=info ts=2022-08-23T05:21:14.667Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..."
2022-08-23_05:21:14.71970 level=info ts=2022-08-23T05:21:14.719Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=master, revision=)"
2022-08-23_05:21:14.71974 level=info ts=2022-08-23T05:21:14.719Z caller=main.go:226 build_context="(go=go1.17.6, user=GitLab-Omnibus, date=)"
2022-08-23_05:21:14.72175 level=info ts=2022-08-23T05:21:14.721Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s
2022-08-23_05:21:14.76730 level=info ts=2022-08-23T05:21:14.767Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/var/opt/gitlab/alertmanager/alertmanager.yml
2022-08-23_05:21:14.76755 level=info ts=2022-08-23T05:21:14.767Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/var/opt/gitlab/alertmanager/alertmanager.yml
2022-08-23_05:21:14.77183 level=info ts=2022-08-23T05:21:14.771Z caller=main.go:518 msg=Listening address=localhost:9093
2022-08-23_05:21:14.77231 level=info ts=2022-08-23T05:21:14.772Z caller=tls_config.go:191 msg="TLS is disabled." http2=false
2022-08-23_05:21:16.72266 level=info ts=2022-08-23T05:21:16.722Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000727584s
2022-08-23_05:21:24.72397 level=info ts=2022-08-23T05:21:24.723Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.002134705s

==> /var/log/gitlab/alertmanager/state <==

==> /var/log/gitlab/puma/current <==
2022-08-23_05:21:24.75564 {"timestamp":"2022-08-23T05:21:24.755Z","pid":17288,"message":"*  Environment: production"}
2022-08-23_05:21:24.75567 {"timestamp":"2022-08-23T05:21:24.755Z","pid":17288,"message":"*   Master PID: 17288"}
2022-08-23_05:21:24.75570 {"timestamp":"2022-08-23T05:21:24.755Z","pid":17288,"message":"*      Workers: 4"}
2022-08-23_05:21:24.75577 {"timestamp":"2022-08-23T05:21:24.755Z","pid":17288,"message":"*     Restarts: (?) hot (?) phased"}
2022-08-23_05:21:24.75580 {"timestamp":"2022-08-23T05:21:24.755Z","pid":17288,"message":"* Preloading application"}
2022-08-23_05:22:17.71884 {"timestamp":"2022-08-23T05:22:17.718Z","pid":17288,"message":"* Listening on unix:///var/opt/gitlab/gitlab-rails/sockets/gitlab.socket"}
2022-08-23_05:22:17.71909 {"timestamp":"2022-08-23T05:22:17.718Z","pid":17288,"message":"* Listening on http://127.0.0.1:8080"}
2022-08-23_05:22:17.71920 {"timestamp":"2022-08-23T05:22:17.719Z","pid":17288,"message":"! WARNING: Detected 1 Thread(s) started in app boot:"}
2022-08-23_05:22:17.71935 {"timestamp":"2022-08-23T05:22:17.719Z","pid":17288,"message":"! #\u003cThread:0x00007f2a127ae070 /opt/gitlab/embedded/lib/ruby/gems/2.7.0/gems/rack-timeout-0.6.0/lib/rack/timeout/support/scheduler.rb:73 sleep\u003e - /opt/gitlab/embedded/lib/ruby/gems/2.7.0/gems/rack-timeout-0.6.0/lib/rack/timeout/support/scheduler.rb:91:in `sleep'"}
2022-08-23_05:22:17.71954 {"timestamp":"2022-08-23T05:22:17.719Z","pid":17288,"message":"Use Ctrl-C to stop"}

==> /var/log/gitlab/puma/puma_stdout.log <==
{"timestamp":"2022-08-23T06:33:01.627Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3832.9921875 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:33:21.628Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3833.9609375 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:33:41.630Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3831.81640625 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:34:01.632Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3840.28515625 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:34:21.634Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3837.31640625 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:34:41.636Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3837.58984375 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:35:01.638Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3837.44140625 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:35:21.640Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3830.30078125 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:35:41.641Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3830.671875 mb with master and 4 workers."}
{"timestamp":"2022-08-23T06:36:01.642Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3831.35546875 mb with master and 4 workers."}

==> /var/log/gitlab/puma/state <==

==> /var/log/gitlab/puma/puma_stderr.log <==
=== puma startup: 2022-08-23 09:22:33 +0800 ===
=== puma startup: 2022-08-23 09:24:56 +0800 ===
=== puma startup: 2022-08-23 09:38:34 +0800 ===
=== puma startup: 2022-08-23 09:53:27 +0800 ===
=== puma startup: 2022-08-23 10:03:39 +0800 ===
=== puma startup: 2022-08-23 10:18:00 +0800 ===
=== puma startup: 2022-08-23 10:31:13 +0800 ===
=== puma startup: 2022-08-23 11:35:04 +0800 ===
=== puma startup: 2022-08-23 13:04:48 +0800 ===
=== puma startup: 2022-08-23 13:22:17 +0800 ===

==> /var/log/gitlab/gitlab-kas/current <==
2022-08-23_05:03:49.31247 {"level":"info","time":"2022-08-23T13:03:49.312+0800","msg":"Observability endpoint is up","mod_name":"observability","net_network":"tcp","net_address":"127.0.0.1:8151"}
2022-08-23_05:03:49.31283 {"level":"info","time":"2022-08-23T13:03:49.312+0800","msg":"Agentk API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8150","is_websocket":true}
2022-08-23_05:03:49.31360 {"level":"info","time":"2022-08-23T13:03:49.312+0800","msg":"Private API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8155"}
2022-08-23_05:03:49.31362 {"level":"info","time":"2022-08-23T13:03:49.313+0800","msg":"Kubernetes API endpoint is up","mod_name":"kubernetes_api","net_network":"tcp","net_address":"127.0.0.1:8154"}
2022-08-23_05:03:49.31363 {"level":"info","time":"2022-08-23T13:03:49.313+0800","msg":"API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8153"}
2022-08-23_05:21:16.88868 {"level":"info","time":"2022-08-23T13:21:16.888+0800","msg":"Observability endpoint is up","mod_name":"observability","net_network":"tcp","net_address":"127.0.0.1:8151"}
2022-08-23_05:21:16.88928 {"level":"info","time":"2022-08-23T13:21:16.889+0800","msg":"Agentk API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8150","is_websocket":true}
2022-08-23_05:21:16.88957 {"level":"info","time":"2022-08-23T13:21:16.889+0800","msg":"Kubernetes API endpoint is up","mod_name":"kubernetes_api","net_network":"tcp","net_address":"127.0.0.1:8154"}
2022-08-23_05:21:16.89025 {"level":"info","time":"2022-08-23T13:21:16.890+0800","msg":"Private API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8155"}
2022-08-23_05:21:16.89029 {"level":"info","time":"2022-08-23T13:21:16.890+0800","msg":"API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8153"}

==> /var/log/gitlab/gitlab-kas/state <==

==> /var/log/gitlab/gitaly/gitaly_ruby_json.log <==
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:36:12Z","grpc.time_ms":0.407,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17264,"correlation_id":"84f1240ad320abc13fa713cdb94994a6","time":"2022-08-23T06:36:12.009Z"}
{"type":"gitaly-ruby","grpc.start_time":"2022-08-23T06:36:12Z","grpc.time_ms":0.27,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":17266,"correlation_id":"82846a44b4cd4e9a57d6d53857a34196","time":"2022-08-23T06:36:12.009Z"}

==> /var/log/gitlab/gitlab-exporter/current <==
2022-08-23_06:36:14.27525 Passing 'exists?' command to redis as is; blind passthrough has been deprecated and will be removed in redis-namespace 2.0 (at /opt/gitlab/embedded/lib/ruby/gems/2.7.0/gems/sidekiq-6.4.0/lib/sidekiq/api.rb:962:in `block (3 levels) in each')
2022-08-23_06:36:14.34361 127.0.0.1 - - [23/Aug/2022:14:36:13 CST] "GET /sidekiq HTTP/1.1" 200 86564
2022-08-23_06:36:14.34368 - -> /sidekiq
2022-08-23_06:36:15.75310 127.0.0.1 - - [23/Aug/2022:14:36:15 CST] "GET /database HTTP/1.1" 200 3862
2022-08-23_06:36:15.75317 - -> /database

==> /var/log/gitlab/postgres-exporter/current <==
2022-08-23_06:36:18.98487 ts=2022-08-23T06:36:18.984Z caller=log.go:168 level=debug msg="Querying PostgreSQL version" server=/var/opt/gitlab/postgresql:5432
2022-08-23_06:36:18.98576 ts=2022-08-23T06:36:18.985Z caller=log.go:168 level=debug msg="Querying pg_setting view" server=/var/opt/gitlab/postgresql:5432
2022-08-23_06:36:18.98922 ts=2022-08-23T06:36:18.989Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_replication
2022-08-23_06:36:18.99090 ts=2022-08-23T06:36:18.990Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_activity_autovacuum_active
2022-08-23_06:36:18.99241 ts=2022-08-23T06:36:18.992Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_long_running_transactions_marginalia
2022-08-23_06:36:18.99373 ts=2022-08-23T06:36:18.993Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_activity_marginalia_sampler
2022-08-23_06:36:19.00868 ts=2022-08-23T06:36:19.008Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_slow
2022-08-23_06:36:19.01001 ts=2022-08-23T06:36:19.009Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_database
2022-08-23_06:36:19.02373 ts=2022-08-23T06:36:19.023Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_locks
2022-08-23_06:36:19.02535 ts=2022-08-23T06:36:19.025Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_vacuum
2022-08-23_06:36:19.02674 ts=2022-08-23T06:36:19.026Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_long_running_transactions
2022-08-23_06:36:19.02802 ts=2022-08-23T06:36:19.027Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_replication
2022-08-23_06:36:19.02838 ts=2022-08-23T06:36:19.028Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_blocked
2022-08-23_06:36:19.02943 ts=2022-08-23T06:36:19.029Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_database_conflicts
2022-08-23_06:36:19.03220 ts=2022-08-23T06:36:19.032Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_activity
2022-08-23_06:36:19.03411 ts=2022-08-23T06:36:19.034Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_bgwriter
2022-08-23_06:36:19.03687 ts=2022-08-23T06:36:19.036Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stuck_idle_in_transaction
2022-08-23_06:36:19.03825 ts=2022-08-23T06:36:19.038Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_total_relation_size

==> /var/log/gitlab/gitlab-rails/production.log <==
Started GET "/-/metrics" for 127.0.0.1 at 2022-08-23 14:36:19 +0800
Processing by MetricsController#index as HTML
Completed 200 OK in 69ms (Views: 1.0ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 930)

==> /var/log/gitlab/gitlab-rails/production_json.log <==
{"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2022-08-23T06:36:19.149Z","params":[],"redis_calls":2,"redis_duration_s":0.001247,"redis_read_bytes":406,"redis_write_bytes":200,"redis_cache_calls":2,"redis_cache_duration_s":0.001247,"redis_cache_read_bytes":406,"redis_cache_write_bytes":200,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.079373,"mem_objects":2259,"mem_bytes":959640,"mem_mallocs":4599,"mem_total_bytes":1050000,"pid":17588,"worker_id":"puma_0","rate_limiting_gates":[],"correlation_id":"b53fc0d1-fb09-45a7-b7e0-4e731ea086b0","db_duration_s":0.0,"view_duration_s":0.00096,"duration_s":0.06942}

==> /var/log/gitlab/postgres-exporter/current <==
2022-08-23_06:36:19.18578 ts=2022-08-23T06:36:19.185Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_vacuum_analyze
2022-08-23_06:36:19.18736 ts=2022-08-23T06:36:19.187Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_postmaster
2022-08-23_06:36:19.18765 ts=2022-08-23T06:36:19.187Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_replication_slots
2022-08-23_06:36:19.18830 ts=2022-08-23T06:36:19.188Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_archiver
2022-08-23_06:36:19.19102 ts=2022-08-23T06:36:19.190Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_vacuum_queue
2022-08-23_06:36:19.20842 ts=2022-08-23T06:36:19.208Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_stat_activity_autovacuum
2022-08-23_06:36:19.20953 ts=2022-08-23T06:36:19.209Z caller=log.go:168 level=debug msg="Querying namespace" namespace=pg_oldest_blocked

==> /var/log/gitlab/gitlab-rails/production.log <==
Started GET "/globalip/ui/is" for 125.35.78.118 at 2022-08-23 14:36:19 +0800
Processing by ProjectsController#show as HTML
  Parameters: {"namespace_id"=>"globalip/ui", "id"=>"is"}

==> /var/log/gitlab/gitaly/current <==
{"command.count":1,"command.cpu_time_ms":2,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":152,"command.oublock":0,"command.real_time_ms":3,"command.system_time_ms":0,"command.user_time_ms":2,"correlation_id":"01GB4PN3FAZVB2CSSCMPZKT1W7","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-web","grpc.meta.deadline_type":"regular","grpc.meta.method_type":"unary","grpc.method":"FindDefaultBranchName","grpc.request.deadline":"2022-08-23T14:36:30.007","grpc.request.fullMethod":"/gitaly.RefService/FindDefaultBranchName","grpc.request.glProjectPath":"globalip/ui/is","grpc.request.glRepository":"project-7","grpc.request.payload_bytes":122,"grpc.request.repoPath":"@hashed/79/02/7902699be42c8a8e46fbbb4501726517e86b22c56a189f7625a6da49081b2451.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":0,"grpc.service":"gitaly.RefService","grpc.start_time":"2022-08-23T14:36:20.197","grpc.time_ms":3.808,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":17179,"remote_ip":"125.35.78.118","span.kind":"server","system":"grpc","time":"2022-08-23T06:36:20.201Z","username":"jenkins"}
{"command.count":1,"command.cpu_time_ms":2,"command.inblock":0,"command.majflt":0,"command.maxrss":262196,"command.minflt":150,"command.oublock":0,"command.real_time_ms":3,"command.system_time_ms":2,"command.user_time_ms":0,"correlation_id":"01GB4PN3FAZVB2CSSCMPZKT1W7","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-web","grpc.meta.deadline_type":"regular","grpc.meta.method_type":"unary","grpc.method":"HasLocalBranches","grpc.request.deadline":"2022-08-23T14:36:30.004","grpc.request.fullMethod":"/gitaly.RepositoryService/HasLocalBranches","grpc.request.glProjectPath":"globalip/ui/is","grpc.request.glRepository":"project-7","grpc.request.payload_bytes":122,"grpc.request.repoPath":"@hashed/79/02/7902699be42c8a8e46fbbb4501726517e86b22c56a189f7625a6da49081b2451.git","grpc.request.repoStorage":"default","grpc.response.payload_bytes":0,"grpc.service":"gitaly.RepositoryService","grpc.start_time":"2022-08-23T14:36:20.224","grpc.time_ms":3.404,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":17179,"remote_ip":"125.35.78.118","span.kind":"server","system":"grpc","time":"2022-08-23T06:36:20.228Z","username":"jenkins"}

==> /var/log/gitlab/gitlab-rails/production.log <==
  Rendered layout layouts/project.html.haml (Duration: 772.4ms | Allocations: 179606)
Completed 200 OK in 902ms (Views: 734.1ms | ActiveRecord: 54.2ms | Elasticsearch: 0.0ms | Allocations: 197313)

==> /var/log/gitlab/gitlab-rails/production_json.log <==
{"method":"GET","path":"/globalip/ui/is","format":"html","controller":"ProjectsController","action":"show","status":200,"time":"2022-08-23T06:36:21.005Z","params":[{"key":"namespace_id","value":"globalip/ui"},{"key":"id","value":"is"}],"correlation_id":"01GB4PN3FAZVB2CSSCMPZKT1W7","meta.user":"jenkins","meta.project":"globalip/ui/is","meta.root_namespace":"globalip","meta.client_id":"user/2","meta.caller_id":"ProjectsController#show","meta.remote_ip":"125.35.78.118","meta.feature_category":"projects","remote_ip":"125.35.78.118","user_id":2,"username":"jenkins","ua":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","queue_duration_s":0.045661,"request_urgency":"low","target_duration_s":5,"gitaly_calls":2,"gitaly_duration_s":0.014698,"redis_calls":57,"redis_duration_s":0.041240000000000006,"redis_read_bytes":10062,"redis_write_bytes":6825,"redis_cache_calls":55,"redis_cache_duration_s":0.039815,"redis_cache_read_bytes":9879,"redis_cache_write_bytes":5067,"redis_shared_state_calls":1,"redis_shared_state_duration_s":0.000729,"redis_shared_state_write_bytes":106,"redis_sessions_calls":1,"redis_sessions_duration_s":0.000696,"redis_sessions_read_bytes":183,"redis_sessions_write_bytes":1652,"db_count":47,"db_write_count":0,"db_cached_count":6,"db_replica_count":0,"db_primary_count":47,"db_main_count":47,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":6,"db_main_cached_count":6,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.096,"db_main_duration_s":0.096,"db_main_replica_duration_s":0.0,"cpu_s":1.085476,"mem_objects":212689,"mem_bytes":13429118,"mem_mallocs":44652,"mem_total_bytes":21936678,"pid":17592,"worker_id":"puma_2","rate_limiting_gates":[],"db_duration_s":0.0542,"view_duration_s":0.73413,"duration_s":0.90187}

==> /var/log/gitlab/gitlab-workhorse/current <==
{"content_type":"text/html; charset=utf-8","correlation_id":"01GB4PN3FAZVB2CSSCMPZKT1W7","duration_ms":1191,"host":"58.32.237.86:9200","level":"info","method":"GET","msg":"access","proto":"HTTP/1.1","referrer":"http://58.32.237.86:9200/","remote_addr":"125.35.78.118:34088","remote_ip":"125.35.78.118","route":"","status":200,"system":"http","time":"2022-08-23T14:36:21+08:00","ttfb_ms":1190,"uri":"/globalip/ui/is","user_agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36","written_bytes":113005}

==> /var/log/gitlab/nginx/gitlab_access.log <==
125.35.78.118 - - [23/Aug/2022:14:36:21 +0800] "GET /globalip/ui/is HTTP/1.1" 200 24174 "http://58.32.237.86:9200/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" 4.68

==> /var/log/gitlab/sidekiq/current <==
{"severity":"INFO","time":"2022-08-23T06:36:21.327Z","retry":0,"queue":"cronjob:database_batched_background_migration_ci_database","version":0,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0f66a47d4d873d5816602bac","created_at":"2022-08-23T06:36:21.322Z","meta.caller_id":"Cronjob","correlation_id":"912c9880beddc272da648c44464129de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:database_batched_background_migration_ci_database:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2022-08-23T06:36:21.325Z","job_size_bytes":2,"pid":17389,"message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0f66a47d4d873d5816602bac: start","job_status":"start","scheduling_latency_s":0.001494}
{"severity":"INFO","time":"2022-08-23T06:36:21.384Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"skipping migration execution for unconfigured database","retry":0}
{"severity":"INFO","time":"2022-08-23T06:36:21.388Z","retry":0,"queue":"cronjob:database_batched_background_migration_ci_database","version":0,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0f66a47d4d873d5816602bac","created_at":"2022-08-23T06:36:21.322Z","meta.caller_id":"Cronjob","correlation_id":"912c9880beddc272da648c44464129de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:database_batched_background_migration_ci_database:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2022-08-23T06:36:21.325Z","job_size_bytes":2,"pid":17389,"message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0f66a47d4d873d5816602bac: done: 0.061099 sec","job_status":"done","scheduling_latency_s":0.001494,"redis_calls":1,"redis_duration_s":0.000183,"redis_read_bytes":10,"redis_write_bytes":412,"redis_queues_calls":1,"redis_queues_duration_s":0.000183,"redis_queues_read_bytes":10,"redis_queues_write_bytes":412,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.00395,"mem_objects":1092,"mem_bytes":116568,"mem_mallocs":262,"mem_total_bytes":160248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.061099,"completed_at":"2022-08-23T06:36:21.388Z","load_balancing_strategy":"primary","db_duration_s":0.0}
{"severity":"INFO","time":"2022-08-23T06:36:21.389Z","retry":0,"queue":"cronjob:schedule_merge_request_cleanup_refs","version":0,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"10824ca3919d715860d5a6af","created_at":"2022-08-23T06:36:21.377Z","meta.caller_id":"Cronjob","correlation_id":"b0f19e5053e9175da3860b7125dcd2e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:schedule_merge_request_cleanup_refs:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2022-08-23T06:36:21.382Z","job_size_bytes":2,"pid":17389,"message":"ScheduleMergeRequestCleanupRefsWorker JID-10824ca3919d715860d5a6af: start","job_status":"start","scheduling_latency_s":0.007319}
{"severity":"INFO","time":"2022-08-23T06:36:21.418Z","retry":0,"queue":"cronjob:schedule_merge_request_cleanup_refs","version":0,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"10824ca3919d715860d5a6af","created_at":"2022-08-23T06:36:21.377Z","meta.caller_id":"Cronjob","correlation_id":"b0f19e5053e9175da3860b7125dcd2e2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:schedule_merge_request_cleanup_refs:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2022-08-23T06:36:21.382Z","job_size_bytes":2,"pid":17389,"message":"ScheduleMergeRequestCleanupRefsWorker JID-10824ca3919d715860d5a6af: done: 0.029352 sec","job_status":"done","scheduling_latency_s":0.007319,"redis_calls":1,"redis_duration_s":0.00019,"redis_read_bytes":10,"redis_write_bytes":384,"redis_queues_calls":1,"redis_queues_duration_s":0.00019,"redis_queues_read_bytes":10,"redis_queues_write_bytes":384,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.003957,"mem_objects":1104,"mem_bytes":84616,"mem_mallocs":249,"mem_total_bytes":128776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.029352,"completed_at":"2022-08-23T06:36:21.418Z","load_balancing_strategy":"primary","db_duration_s":0.0}
{"severity":"INFO","time":"2022-08-23T06:36:21.422Z","retry":0,"queue":"cronjob:database_batched_background_migration","version":0,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d192fc5a52788481b5b75ad3","created_at":"2022-08-23T06:36:21.411Z","meta.caller_id":"Cronjob","correlation_id":"ba07dfb16fd63cc98707fc192475edc0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:database_batched_background_migration:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2022-08-23T06:36:21.412Z","job_size_bytes":2,"pid":17389,"message":"Database::BatchedBackgroundMigrationWorker JID-d192fc5a52788481b5b75ad3: start","job_status":"start","scheduling_latency_s":0.009432}

==> /var/log/gitlab/puma/puma_stdout.log <==
{"timestamp":"2022-08-23T06:36:21.644Z","pid":17288,"message":"PumaWorkerKiller: Consuming 3826.1796875 mb with master and 4 workers."}

==> /var/log/gitlab/sidekiq/current <==
{"severity":"INFO","time":"2022-08-23T06:36:21.653Z","retry":0,"queue":"cronjob:database_batched_background_migration","version":0,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d192fc5a52788481b5b75ad3","created_at":"2022-08-23T06:36:21.411Z","meta.caller_id":"Cronjob","correlation_id":"ba07dfb16fd63cc98707fc192475edc0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:database_batched_background_migration:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2022-08-23T06:36:21.412Z","job_size_bytes":2,"pid":17389,"message":"Database::BatchedBackgroundMigrationWorker JID-d192fc5a52788481b5b75ad3: done: 0.231506 sec","job_status":"done","scheduling_latency_s":0.009432,"redis_calls":1,"redis_duration_s":0.050741,"redis_read_bytes":10,"redis_write_bytes":388,"redis_queues_calls":1,"redis_queues_duration_s":0.050741,"redis_queues_read_bytes":10,"redis_queues_write_bytes":388,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_duration_s":0.006,"db_main_replica_duration_s":0.0,"cpu_s":0.007257,"mem_objects":1596,"mem_bytes":93184,"mem_mallocs":335,"mem_total_bytes":157024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.231506,"completed_at":"2022-08-23T06:36:21.653Z","load_balancing_strategy":"primary","db_duration_s":0.005847}
{"severity":"INFO","time":"2022-08-23T06:36:21.654Z","retry":0,"queue":"cronjob:user_status_cleanup_batch","version":0,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b97ebfd365bdf75ea2a64a04","created_at":"2022-08-23T06:36:21.598Z","meta.caller_id":"Cronjob","correlation_id":"b938e2778d05e3d0ea893e55c029cc6b","meta.root_caller_id":"Cronjob","meta.feature_category":"users","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:user_status_cleanup_batch:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2022-08-23T06:36:21.599Z","job_size_bytes":2,"pid":17389,"message":"UserStatusCleanup::BatchWorker JID-b97ebfd365bdf75ea2a64a04: start","job_status":"start","scheduling_latency_s":0.055368}
{"severity":"INFO","time":"2022-08-23T06:36:21.667Z","retry":0,"queue":"cronjob:loose_foreign_keys_cleanup","version":0,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"719104262c6d39e91d7bbc42","created_at":"2022-08-23T06:36:21.658Z","meta.caller_id":"Cronjob","correlation_id":"d5a83697eb71f4f6f8bafb1e0b91cfc6","meta.root_caller_id":"Cronjob","meta.feature_category":"pods","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:loose_foreign_keys_cleanup:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2022-08-23T06:36:21.659Z","job_size_bytes":2,"pid":17389,"message":"LooseForeignKeys::CleanupWorker JID-719104262c6d39e91d7bbc42: start","job_status":"start","scheduling_latency_s":0.007716}
{"severity":"INFO","time":"2022-08-23T06:36:21.678Z","retry":0,"queue":"cronjob:user_status_cleanup_batch","version":0,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b97ebfd365bdf75ea2a64a04","created_at":"2022-08-23T06:36:21.598Z","meta.caller_id":"Cronjob","correlation_id":"b938e2778d05e3d0ea893e55c029cc6b","meta.root_caller_id":"Cronjob","meta.feature_category":"users","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:user_status_cleanup_batch:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2022-08-23T06:36:21.599Z","job_size_bytes":2,"pid":17389,"message":"UserStatusCleanup::BatchWorker JID-b97ebfd365bdf75ea2a64a04: done: 0.023336 sec","job_status":"done","scheduling_latency_s":0.055368,"redis_calls":1,"redis_duration_s":0.00022,"redis_read_bytes":10,"redis_write_bytes":364,"redis_queues_calls":1,"redis_queues_duration_s":0.00022,"redis_queues_read_bytes":10,"redis_queues_write_bytes":364,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_duration_s":0.003,"db_main_replica_duration_s":0.0,"cpu_s":0.005122,"mem_objects":1313,"mem_bytes":88272,"mem_mallocs":274,"mem_total_bytes":140792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.023336,"completed_at":"2022-08-23T06:36:21.678Z","load_balancing_strategy":"primary","db_duration_s":0.002835}
{"severity":"INFO","time":"2022-08-23T06:36:21.703Z","retry":0,"queue":"cronjob:loose_foreign_keys_cleanup","version":0,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"719104262c6d39e91d7bbc42","created_at":"2022-08-23T06:36:21.658Z","meta.caller_id":"Cronjob","correlation_id":"d5a83697eb71f4f6f8bafb1e0b91cfc6","meta.root_caller_id":"Cronjob","meta.feature_category":"pods","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:loose_foreign_keys_cleanup:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2022-08-23T06:36:21.659Z","job_size_bytes":2,"pid":17389,"message":"LooseForeignKeys::CleanupWorker JID-719104262c6d39e91d7bbc42: done: 0.036223 sec","job_status":"done","scheduling_latency_s":0.007716,"redis_calls":3,"redis_duration_s":0.000771,"redis_read_bytes":12,"redis_write_bytes":667,"redis_queues_calls":1,"redis_queues_duration_s":0.000245,"redis_queues_read_bytes":10,"redis_queues_write_bytes":366,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":2,"redis_shared_state_write_bytes":301,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":9,"db_main_count":9,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_duration_s":0.005,"db_main_replica_duration_s":0.0,"cpu_s":0.022502,"mem_objects":5364,"mem_bytes":285528,"mem_mallocs":1062,"mem_total_bytes":500088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main"},"duration_s":0.036223,"completed_at":"2022-08-23T06:36:21.703Z","load_balancing_strategy":"primary","db_duration_s":0.01032}

==> /var/log/gitlab/gitlab-exporter/current <==
2022-08-23_06:36:23.98265 127.0.0.1 - - [23/Aug/2022:14:36:23 CST] "GET /ruby HTTP/1.1" 200 1001
2022-08-23_06:36:23.98283 - -> /ruby

Details of package version

Provide the package version installation details

yorick@CN-S-ZEVQDEX:/etc/gitlab$ dpkg-query -l "gitlab-*"
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name                                                  Version                         Architecture                    Description
+++-=====================================================-===============================-===============================-===============================================================================================================
ii  gitlab-ce                                             15.2.2-ce.0                     amd64                           GitLab Community Edition (including NGINX, Postgres, Redis)
un  gitlab-ee                                                                                                 (no description available)
un  gitlab-fips                                                                                               (no description available)

Environment details

• Operating System: Ubuntu 18.04.6 LTS

• Installation Target

  • VM: Linux version 4.15.0-151-generic (buildd@lgw01-amd64-042) (gcc version 7.5.0 (Ubuntu 7.5.0-3ubuntu1~18.04)) #157-Ubuntu SMP Fri Jul 9 23:07:57 UTC 2021

• Installation Type, remove incorrect values:

  • Other: remove v15.2.2 then install v15.3.0 but restore failed since backup version mismatch, hence re-install v15.2.2

• Is there any other software running on the machine: SVN,Bugzilla

• Is this a single or multiple node installation? Single

• Resources

  • CPU: 4
  • Memory total:
    total used free shared buff/cache available Mem: 7976 4418 539 118 3018 3142 Swap: 8189 36 8153

Configuration details

git_data_dirs({ "default" => { "path" => "/data/gitlab/git-data" } })