root user is not created on first initialization
### Summary Unable to login to gitlab-ce 15.7.0 as root ### Steps to reproduce Run via docker-compose gitlab-ce version 15.7.0 ``` version: '3' services: gitlab_server: image: 'gitlab/gitlab-ce:15.7.0-ce.0' restart: always hostname: 'gitlab.mydomain.ru' container_name: "gitlab-web" environment: GITLAB_OMNIBUS_CONFIG: | external_url 'http://gitlab.mydomain.ru:80' gitlab_rails['gitlab_shell_ssh_port'] = 22 gitlab_rails['initial_root_password'] = 'my_initial_root_password' gitlab_rails['initial_shared_runners_registration_token'] = '8zUihszsRtZzQAp1sg7m' postgresql['listen_address'] = '*' postgresql['port'] = 5432 postgresql['md5_auth_cidr_addresses'] = %w() postgresql['sql_user'] = "gitlab" postgresql['trust_auth_cidr_addresses'] = %w(0.0.0.0/0) gitlab_rails['db_host'] = '127.0.0.1' gitlab_rails['db_port'] = 5432 gitlab_rails['db_username'] = "gitlab" gitlab_rails['db_password'] = "7d6a4ee82378f6f368b1177f3040efa1" gitlab_rails['env'] = { 'GITLAB_UNICORN_MEMORY_MIN' => '786432000', 'GITLAB_UNICORN_MEMORY_MAX' => '1572864000' } ports: - '8080:80' - '8022:22' - '5432:5432' - '8443:443' volumes: - './gitlab-web/config:/etc/gitlab' - './gitlab-web/logs:/var/log/gitlab' - './gitlab-web/data:/var/opt/gitlab' - /etc/timezone:/etc/timezone:ro - /etc/localtime:/etc/localtime:ro networks: - gitlab-net gitlab_runner: image: 'gitlab/gitlab-runner:latest' container_name: gitlab-runner volumes: - /var/run/docker.sock:/var/run/docker.sock - ./gitlab-runner/config:/etc/gitlab-runner depends_on: - gitlab_server networks: - gitlab-net networks: gitlab-net: ``` ### What is the current *bug* behavior? No root user created after first run. There are no users in the users database table: ``` gitlabhq_production=> select * from users; id | email | encrypted_password | reset_password_token | reset_password_sent_at | remember_created_at | sign_in_count | current_sign_in_at | last_sign_in_at | current_sign_in_ip | last_sign_in_ip | created_at | updated_at | name | admin | projects_limit | skype | linkedin | twitter | failed_attempts | locked_at | username | can_create_group | can_create_team | state | color_scheme_id | password_expires_at | created_by_id | last_credential_check_at | avatar | confirmation_token | confirmed_at | confirmation_sent_at | unconfirmed_email | hide_no_ssh_key | website_url | admin_email_unsubscribed_at | notification_email | hide_no_password | password_automatically_set | location | encrypted_otp_secret | encrypted_otp_secret_iv | encrypted_otp_secret_salt | otp_required_for_login | otp_backup_codes | public_email | dashboard | project_view | consumed_timestep | layout | hide_project_limit | note | unlock_token | otp_grace_period_started_at | external | incoming_email_token | organization | auditor | require_two_factor_authentication_from_group | two_factor_grace_period | last_activity_on | notified_of_own_activity | preferred_language | email_opted_in | email_opted_in_ip | email_opted_in_source_id | email_opted_in_at | theme_id | accepted_term_id | feed_token | private_profile | roadmap_layout | include_private_contributions | commit_email | group_view | managing_group_id | first_name | last_name | static_object_token | role | user_type | static_object_token_encrypted | otp_secret_expires_at | onboarding_in_progress ----+-------+--------------------+----------------------+------------------------+---------------------+---------------+--------------------+-----------------+--------------------+-----------------+------------+------------+------+-------+----------------+-------+----------+---------+-----------------+-----------+----------+------------------+-----------------+-------+-----------------+---------------------+---------------+--------------------------+--------+--------------------+--------------+----------------------+-------------------+-----------------+-------------+-----------------------------+--------------------+------------------+----------------------------+----------+----------------------+-------------------------+---------------------------+------------------------+------------------+--------------+-----------+--------------+-------------------+--------+--------------------+------+--------------+-----------------------------+----------+----------------------+--------------+---------+----------------------------------------------+-------------------------+------------------+--------------------------+--------------------+----------------+-------------------+--------------------------+-------------------+----------+------------------+------------+-----------------+----------------+-------------------------------+--------------+------------+-------------------+------------+-----------+---------------------+------+-----------+-------------------------------+-----------------------+------------------------ (0 rows) : ``` for version 15.6.3 the behavior is correct ### What is the expected *correct* behavior? After the first launch of gitlab, you can log in as root using a predefined password: ### Relevant logs ``` root@gitlab:/# gitlab-ctl tail ==> /var/log/gitlab/sidekiq/current <== {"severity":"INFO","time":"2023-01-05T21:30:01.938Z","retry":0,"queue":"cronjob:container_registry_migration_guard","version":0,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::Migration::GuardWorker","jid":"ed08cfcc82b279b5b77feb49","created_at":"2023-01-05T21:30:01.935Z","meta.caller_id":"Cronjob","correlation_id":"5d8529ab82aeeb9880e8ae4f48adaa75","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:container_registry_migration_guard:3c8dd7cf643eff5725a29a8a5f25859b466be1555e7b4ec13a87248a51b85c4c","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.936Z","job_size_bytes":2,"pid":457,"message":"ContainerRegistry::Migration::GuardWorker JID-ed08cfcc82b279b5b77feb49: start","job_status":"start","scheduling_latency_s":0.002575} {"severity":"INFO","time":"2023-01-05T21:30:01.940Z","retry":0,"queue":"cronjob:user_status_cleanup_batch","version":0,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"74d2d5a9e04fe6cda6c975fa","created_at":"2023-01-05T21:30:01.929Z","meta.caller_id":"Cronjob","correlation_id":"58c7758e52334ce47b4368c3d67ccb83","meta.root_caller_id":"Cronjob","meta.feature_category":"users","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:user_status_cleanup_batch:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.929Z","job_size_bytes":2,"pid":457,"message":"UserStatusCleanup::BatchWorker JID-74d2d5a9e04fe6cda6c975fa: done: 0.009183 sec","job_status":"done","scheduling_latency_s":0.001386,"redis_calls":2,"redis_duration_s":0.000844,"redis_read_bytes":2,"redis_write_bytes":212,"redis_queues_calls":2,"redis_queues_duration_s":0.000844,"redis_queues_read_bytes":2,"redis_queues_write_bytes":212,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_duration_s":0.001,"db_main_replica_duration_s":0.0,"cpu_s":0.002042,"mem_objects":1555,"mem_bytes":114240,"mem_mallocs":342,"mem_total_bytes":176440,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.009183,"completed_at":"2023-01-05T21:30:01.940Z","load_balancing_strategy":"primary","db_duration_s":0.001283} {"severity":"INFO","time":"2023-01-05T21:30:01.946Z","retry":0,"queue":"cronjob:container_registry_migration_guard","version":0,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::Migration::GuardWorker","jid":"ed08cfcc82b279b5b77feb49","created_at":"2023-01-05T21:30:01.935Z","meta.caller_id":"Cronjob","correlation_id":"5d8529ab82aeeb9880e8ae4f48adaa75","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:container_registry_migration_guard:3c8dd7cf643eff5725a29a8a5f25859b466be1555e7b4ec13a87248a51b85c4c","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.936Z","job_size_bytes":2,"pid":457,"message":"ContainerRegistry::Migration::GuardWorker JID-ed08cfcc82b279b5b77feb49: done: 0.007663 sec","job_status":"done","scheduling_latency_s":0.002575,"redis_calls":2,"redis_duration_s":0.002134,"redis_read_bytes":2,"redis_write_bytes":221,"redis_queues_calls":2,"redis_queues_duration_s":0.002134,"redis_queues_read_bytes":2,"redis_queues_write_bytes":221,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.001507,"mem_objects":1254,"mem_bytes":108232,"mem_mallocs":291,"mem_total_bytes":158392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.007663,"completed_at":"2023-01-05T21:30:01.946Z","load_balancing_strategy":"primary","db_duration_s":0.0} {"severity":"INFO","time":"2023-01-05T21:30:01.948Z","retry":0,"queue":"cronjob:pages_domain_verification_cron","version":0,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"a3c411d434a013adcea3dd3d","created_at":"2023-01-05T21:30:01.945Z","meta.caller_id":"Cronjob","correlation_id":"796651eeb4905d3dabf8868f1e3c4a98","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:pages_domain_verification_cron:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.946Z","job_size_bytes":2,"pid":457,"message":"PagesDomainVerificationCronWorker JID-a3c411d434a013adcea3dd3d: start","job_status":"start","scheduling_latency_s":0.001336} {"severity":"INFO","time":"2023-01-05T21:30:01.971Z","retry":0,"queue":"cronjob:pages_domain_verification_cron","version":0,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"a3c411d434a013adcea3dd3d","created_at":"2023-01-05T21:30:01.945Z","meta.caller_id":"Cronjob","correlation_id":"796651eeb4905d3dabf8868f1e3c4a98","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:pages_domain_verification_cron:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.946Z","job_size_bytes":2,"pid":457,"message":"PagesDomainVerificationCronWorker JID-a3c411d434a013adcea3dd3d: done: 0.023491 sec","job_status":"done","scheduling_latency_s":0.001336,"redis_calls":2,"redis_duration_s":0.016087,"redis_read_bytes":2,"redis_write_bytes":217,"redis_queues_calls":2,"redis_queues_duration_s":0.016087,"redis_queues_read_bytes":2,"redis_queues_write_bytes":217,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_duration_s":0.002,"db_main_replica_duration_s":0.0,"cpu_s":0.002702,"mem_objects":1736,"mem_bytes":116320,"mem_mallocs":369,"mem_total_bytes":185760,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.023491,"completed_at":"2023-01-05T21:30:01.971Z","load_balancing_strategy":"primary","db_duration_s":0.001947} {"severity":"INFO","time":"2023-01-05T21:30:01.971Z","retry":0,"queue":"cronjob:jira_import_stuck_jira_import_jobs","version":0,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"035d3f97fa13e9d616affd47","created_at":"2023-01-05T21:30:01.968Z","meta.caller_id":"Cronjob","correlation_id":"df98b8b470b7f969c8ff554fcf97f712","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:jira_import_stuck_jira_import_jobs:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.969Z","job_size_bytes":2,"pid":457,"message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-035d3f97fa13e9d616affd47: start","job_status":"start","scheduling_latency_s":0.002897} {"severity":"INFO","time":"2023-01-05T21:30:01.985Z","retry":0,"queue":"cronjob:loose_foreign_keys_cleanup","version":0,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7492c2424bbcbbb42ab8927c","created_at":"2023-01-05T21:30:01.919Z","meta.caller_id":"Cronjob","correlation_id":"ac5aeb50384a9f2733a3d8fb0741934b","meta.root_caller_id":"Cronjob","meta.feature_category":"pods","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:loose_foreign_keys_cleanup:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.920Z","job_size_bytes":2,"pid":457,"message":"LooseForeignKeys::CleanupWorker JID-7492c2424bbcbbb42ab8927c: done: 0.06412 sec","job_status":"done","scheduling_latency_s":0.001576,"redis_calls":4,"redis_duration_s":0.001967,"redis_read_bytes":4,"redis_write_bytes":514,"redis_queues_calls":2,"redis_queues_duration_s":0.000633,"redis_queues_read_bytes":2,"redis_queues_write_bytes":213,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001334,"redis_shared_state_read_bytes":2,"redis_shared_state_write_bytes":301,"db_count":10,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":10,"db_main_count":10,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_duration_s":0.029,"db_main_replica_duration_s":0.0,"cpu_s":0.01093,"mem_objects":6202,"mem_bytes":324072,"mem_mallocs":1227,"mem_total_bytes":572152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main"},"duration_s":0.06412,"completed_at":"2023-01-05T21:30:01.985Z","load_balancing_strategy":"primary","db_duration_s":0.040443} {"severity":"INFO","time":"2023-01-05T21:30:01.987Z","retry":0,"queue":"cronjob:jira_import_stuck_jira_import_jobs","version":0,"queue_namespace":"cronjob","args":[],"class":"Gitlab::JiraImport::StuckJiraImportJobsWorker","jid":"035d3f97fa13e9d616affd47","created_at":"2023-01-05T21:30:01.968Z","meta.caller_id":"Cronjob","correlation_id":"df98b8b470b7f969c8ff554fcf97f712","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:jira_import_stuck_jira_import_jobs:b9cf6c9b6c2f8fad80e08693d59af787bb65ad6ffe24ec5d0e1a669517566127","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.969Z","job_size_bytes":2,"pid":457,"message":"Gitlab::JiraImport::StuckJiraImportJobsWorker JID-035d3f97fa13e9d616affd47: done: 0.0153 sec","job_status":"done","scheduling_latency_s":0.002897,"redis_calls":2,"redis_duration_s":0.00801,"redis_read_bytes":2,"redis_write_bytes":221,"redis_queues_calls":2,"redis_queues_duration_s":0.00801,"redis_queues_read_bytes":2,"redis_queues_write_bytes":221,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":2,"db_main_count":2,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_duration_s":0.002,"db_main_replica_duration_s":0.0,"cpu_s":0.002639,"mem_objects":1971,"mem_bytes":121880,"mem_mallocs":415,"mem_total_bytes":200720,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.0153,"completed_at":"2023-01-05T21:30:01.987Z","load_balancing_strategy":"primary","db_duration_s":0.001829} {"severity":"INFO","time":"2023-01-05T21:30:01.987Z","retry":0,"queue":"cronjob:pages_domain_ssl_renewal_cron","version":0,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"f032580a77f60405ee753e0e","created_at":"2023-01-05T21:30:01.982Z","meta.caller_id":"Cronjob","correlation_id":"75336aa692dc3a3cfd2b1def9de7e9c7","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:pages_domain_ssl_renewal_cron:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.983Z","job_size_bytes":2,"pid":457,"message":"PagesDomainSslRenewalCronWorker JID-f032580a77f60405ee753e0e: start","job_status":"start","scheduling_latency_s":0.003999} {"severity":"INFO","time":"2023-01-05T21:30:01.996Z","retry":0,"queue":"cronjob:pages_domain_ssl_renewal_cron","version":0,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"f032580a77f60405ee753e0e","created_at":"2023-01-05T21:30:01.982Z","meta.caller_id":"Cronjob","correlation_id":"75336aa692dc3a3cfd2b1def9de7e9c7","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","idempotency_key":"resque:gitlab:duplicate:cronjob:pages_domain_ssl_renewal_cron:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2023-01-05T21:30:01.983Z","job_size_bytes":2,"pid":457,"message":"PagesDomainSslRenewalCronWorker JID-f032580a77f60405ee753e0e: done: 0.008509 sec","job_status":"done","scheduling_latency_s":0.003999,"redis_calls":2,"redis_duration_s":0.003885,"redis_read_bytes":2,"redis_write_bytes":216,"redis_queues_calls":2,"redis_queues_duration_s":0.003885,"redis_queues_read_bytes":2,"redis_queues_write_bytes":216,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.002978,"mem_objects":2556,"mem_bytes":329592,"mem_mallocs":923,"mem_total_bytes":431832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"duration_s":0.008509,"completed_at":"2023-01-05T21:30:01.996Z","load_balancing_strategy":"primary","db_duration_s":0.0} ==> /var/log/gitlab/logrotate/current <== ==> /var/log/gitlab/postgres-exporter/current <== 2023-01-05_20:37:40.87124 ts=2023-01-05T20:37:40.870Z caller=main.go:135 level=info msg="Listening on address" address=localhost:9187 2023-01-05_20:37:40.87129 ts=2023-01-05T20:37:40.870Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2023-01-05_20:38:00.95744 ts=2023-01-05T20:38:00.957Z caller=server.go:74 level=info msg="Established new database connection" fingerprint=/var/opt/gitlab/postgresql:5432 2023-01-05_20:38:00.95985 ts=2023-01-05T20:38:00.959Z caller=postgres_exporter.go:645 level=info msg="Semantic version changed" server=/var/opt/gitlab/postgresql:5432 from=0.0.0 to=13.8.0 ==> /var/log/gitlab/nginx/gitlab_error.log <== ==> /var/log/gitlab/nginx/access.log <== ==> /var/log/gitlab/nginx/current <== ==> /var/log/gitlab/nginx/gitlab_access.log <== 192.168.128.1 - - [06/Jan/2023:00:28:12 +0300] "GET /api/live/ws HTTP/1.0" 302 93 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" - 192.168.128.1 - - [06/Jan/2023:00:28:27 +0300] "GET /api/live/ws HTTP/1.0" 302 93 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" - 127.0.0.1 - - [06/Jan/2023:00:28:39 +0300] "GET /help HTTP/1.1" 200 70382 "" "curl/7.86.0-DEV" - 192.168.128.1 - - [06/Jan/2023:00:28:48 +0300] "GET /api/live/ws HTTP/1.0" 302 93 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" - 192.168.128.1 - - [06/Jan/2023:00:29:02 +0300] "GET /api/live/ws HTTP/1.0" 302 93 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" - 192.168.128.1 - - [06/Jan/2023:00:29:22 +0300] "GET /api/live/ws HTTP/1.0" 302 93 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" - 192.168.128.1 - - [06/Jan/2023:00:29:36 +0300] "GET /api/live/ws HTTP/1.0" 302 93 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" - 127.0.0.1 - - [06/Jan/2023:00:29:40 +0300] "GET /help HTTP/1.1" 200 70382 "" "curl/7.86.0-DEV" - 192.168.128.1 - - [06/Jan/2023:00:29:47 +0300] "GET /api/live/ws HTTP/1.0" 302 93 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" - 192.168.128.1 - - [06/Jan/2023:00:30:05 +0300] "GET /api/live/ws HTTP/1.0" 302 93 "" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36" - ==> /var/log/gitlab/nginx/error.log <== ==> /var/log/gitlab/gitaly/current <== {"level":"warning","msg":"[core] [Channel #3 SubChannel #5] grpc: addrConn.createTransport failed to connect to {\n \"Addr\": \"/var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.1\",\n \"ServerName\": \"/var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.1\",\n \"Attributes\": null,\n \"BalancerAttributes\": null,\n \"Type\": 0,\n \"Metadata\": null\n}. Err: connection error: desc = \"transport: Error while dialing dial unix /var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.1: connect: no such file or directory\"","pid":380,"system":"system","time":"2023-01-05T20:37:43.824Z"} {"level":"warning","msg":"[core] [Channel #1 SubChannel #4] grpc: addrConn.createTransport failed to connect to {\n \"Addr\": \"/var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.0\",\n \"ServerName\": \"/var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.0\",\n \"Attributes\": null,\n \"BalancerAttributes\": null,\n \"Type\": 0,\n \"Metadata\": null\n}. Err: connection error: desc = \"transport: Error while dialing dial unix /var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.0: connect: no such file or directory\"","pid":380,"system":"system","time":"2023-01-05T20:37:43.824Z"} {"level":"warning","msg":"spawned","supervisor.args":["bundle","exec","bin/ruby-cd","/var/opt/gitlab/gitaly","/opt/gitlab/embedded/service/gitaly-ruby/bin/gitaly-ruby","380","/var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.1"],"supervisor.name":"gitaly-ruby.1","supervisor.pid":466,"time":"2023-01-05T20:37:43.824Z"} {"address":"/var/opt/gitlab/gitaly/gitaly.socket","level":"info","msg":"listening at unix address","time":"2023-01-05T20:37:43.828Z"} {"address":"/var/opt/gitlab/gitaly/run/gitaly-380/sock.d/intern","level":"info","msg":"listening at unix address","time":"2023-01-05T20:37:43.828Z"} {"address":"localhost:9236","level":"info","msg":"starting prometheus listener","time":"2023-01-05T20:37:43.829Z"} {"level":"info","msg":"maintenance: daily scheduled","pid":380,"scheduled":"2023-01-06T12:00:00+03:00","time":"2023-01-05T20:37:43.829Z"} {"level":"info","msg":"PID 466 BUNDLE_GEMFILE=/opt/gitlab/embedded/service/gitaly-ruby/Gemfile","supervisor.args":["bundle","exec","bin/ruby-cd","/var/opt/gitlab/gitaly","/opt/gitlab/embedded/service/gitaly-ruby/bin/gitaly-ruby","380","/var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.1"],"supervisor.name":"gitaly-ruby.1","time":"2023-01-05T20:37:44.029Z"} {"level":"info","msg":"PID 465 BUNDLE_GEMFILE=/opt/gitlab/embedded/service/gitaly-ruby/Gemfile","supervisor.args":["bundle","exec","bin/ruby-cd","/var/opt/gitlab/gitaly","/opt/gitlab/embedded/service/gitaly-ruby/bin/gitaly-ruby","380","/var/opt/gitlab/gitaly/run/gitaly-380/sock.d/ruby.0"],"supervisor.name":"gitaly-ruby.0","time":"2023-01-05T20:37:44.035Z"} {"correlation_id":"37bc2a11e25f181810f8d4f42e3e27b8","grpc.code":"OK","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-sidekiq","grpc.meta.deadline_type":"unknown","grpc.meta.method_type":"unary","grpc.method":"ReadinessCheck","grpc.request.deadline":"2023-01-06T00:21:00.073","grpc.request.fullMethod":"/gitaly.ServerService/ReadinessCheck","grpc.request.payload_bytes":4,"grpc.response.payload_bytes":2,"grpc.service":"gitaly.ServerService","grpc.start_time":"2023-01-06T00:20:05.473","grpc.time_ms":0.015,"level":"info","msg":"finished unary call with code OK","peer.address":"@","pid":380,"span.kind":"server","system":"grpc","time":"2023-01-05T21:20:05.473Z"} ==> /var/log/gitlab/gitaly/gitaly_ruby_json.log <== {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:28:59Z","grpc.time_ms":0.34,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":465,"correlation_id":"5d47303e2fabcc53d2214a69d4405483","time":"2023-01-05T21:28:59.452Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:28:59Z","grpc.time_ms":0.408,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":466,"correlation_id":"e093c7b3f246f2536c8a3fc5d1cb48a7","time":"2023-01-05T21:28:59.452Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:29:14Z","grpc.time_ms":0.087,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":466,"correlation_id":"ab37fdfc15ca9ad9e6a7823bf1490be8","time":"2023-01-05T21:29:14.453Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:29:14Z","grpc.time_ms":0.106,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":465,"correlation_id":"047a54d47051dd768bb3f7c39fe3e488","time":"2023-01-05T21:29:14.453Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:29:29Z","grpc.time_ms":0.155,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":465,"correlation_id":"43df5c8a4721d4b0450307b4b1409ec1","time":"2023-01-05T21:29:29.455Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:29:29Z","grpc.time_ms":0.154,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":466,"correlation_id":"42f62b95e6f9d0ada992e990ac22425d","time":"2023-01-05T21:29:29.455Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:29:44Z","grpc.time_ms":0.378,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":465,"correlation_id":"d3a09b1fdbe242aacd32ea4621595ea3","time":"2023-01-05T21:29:44.458Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:29:44Z","grpc.time_ms":0.468,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":466,"correlation_id":"1c2055f13a8e64607ba5b9611f969a6a","time":"2023-01-05T21:29:44.458Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:29:59Z","grpc.time_ms":0.336,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":466,"correlation_id":"ff5deddd7b877619c0c78e45791406f7","time":"2023-01-05T21:29:59.460Z"} {"type":"gitaly-ruby","grpc.start_time":"2023-01-05T21:29:59Z","grpc.time_ms":0.529,"grpc.code":"OK","grpc.method":"Check","grpc.service":"grpc.health.v1.Health","pid":465,"correlation_id":"2ac868dc44cf4b2a49416aad2d95f771","time":"2023-01-05T21:29:59.460Z"} ==> /var/log/gitlab/gitlab-kas/current <== 2023-01-05_20:37:40.88771 {"level":"info","time":"2023-01-05T23:37:40.887+0300","msg":"Observability endpoint is up","mod_name":"observability","net_network":"tcp","net_address":"127.0.0.1:8151"} 2023-01-05_20:37:40.88790 {"level":"info","time":"2023-01-05T23:37:40.887+0300","msg":"Kubernetes API endpoint is up","mod_name":"kubernetes_api","net_network":"tcp","net_address":"127.0.0.1:8154"} 2023-01-05_20:37:40.88797 {"level":"info","time":"2023-01-05T23:37:40.887+0300","msg":"Agentk API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8150","is_websocket":true} 2023-01-05_20:37:40.88803 {"level":"info","time":"2023-01-05T23:37:40.888+0300","msg":"API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8153"} 2023-01-05_20:37:40.88807 {"level":"info","time":"2023-01-05T23:37:40.888+0300","msg":"Private API endpoint is up","net_network":"tcp","net_address":"127.0.0.1:8155"} ==> /var/log/gitlab/redis-exporter/current <== 2023-01-05_20:37:40.86656 time="2023-01-05T23:37:40+03:00" level=info msg="Redis Metrics Exporter 1.44.0 build date: sha1: Go: go1.18.7 GOOS: linux GOARCH: amd64" 2023-01-05_20:37:40.86735 time="2023-01-05T23:37:40+03:00" level=info msg="Providing metrics at localhost:9121/metrics" ==> /var/log/gitlab/gitlab-rails/sidekiq_client.log <== # Logfile created on 2023-01-05 23:18:54 +0300 by logger.rb/v1.4.2 ==> /var/log/gitlab/gitlab-rails/application.log <== 2023-01-05T21:21:06.386Z: {:message=>"Switched database connection", :connection_name=>"main"} 2023-01-05T21:21:06.386Z: {:message=>"Switched database connection", :connection_name=>"main"} 2023-01-05T21:21:06.386Z: {:message=>"Switched database connection", :connection_name=>"main"} 2023-01-05T21:21:06.386Z: {:message=>"Switched database connection", :connection_name=>"main"} 2023-01-05T21:21:06.386Z: {:message=>"Switched database connection", :connection_name=>"main"} 2023-01-05T21:21:06.386Z: {:message=>"Finished sync of dynamic postgres partitions"} 2023-01-05T21:21:06.386Z: {:message=>"Switched database connection", :connection_name=>"main"} 2023-01-05T21:21:06.389Z: {:message=>"Switched database connection", :connection_name=>"main"} 2023-01-05T21:21:06.393Z: {:message=>"Switched database connection", :connection_name=>"main"} 2023-01-05T21:21:06.395Z: {:message=>"Switched database connection", :connection_name=>"main"} ==> /var/log/gitlab/gitlab-rails/exceptions_json.log <== # Logfile created on 2023-01-05 23:21:30 +0300 by logger.rb/v1.4.2 {"severity":"ERROR","time":"2023-01-05T20:21:30.842Z","correlation_id":null,"exception.class":"Gitlab::Runtime::UnknownProcessError","exception.message":"Failed to identify runtime for process 1030 (bin/rails)","exception.backtrace":["lib/gitlab/runtime.rb:28:in `identify'","config/initializers/9_runtime_identify.rb:4:in `\u003ctop (required)\u003e'","config/environment.rb:7:in `\u003ctop (required)\u003e'"],"user.username":null,"tags.program":"web","tags.locale":"en","tags.feature_category":null,"tags.correlation_id":null} {"severity":"ERROR","time":"2023-01-05T21:14:10.833Z","correlation_id":null,"exception.class":"Gitlab::Runtime::UnknownProcessError","exception.message":"Failed to identify runtime for process 2303 (bin/rails)","exception.backtrace":["lib/gitlab/runtime.rb:28:in `identify'","config/initializers/9_runtime_identify.rb:4:in `\u003ctop (required)\u003e'","config/environment.rb:7:in `\u003ctop (required)\u003e'"],"user.username":null,"tags.program":"web","tags.locale":"en","tags.feature_category":null,"tags.correlation_id":null} ==> /var/log/gitlab/gitlab-rails/auth.log <== {"severity":"INFO","time":"2023-01-05T20:20:22.334Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T20:20:37.356Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T20:20:56.760Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T20:21:03.597Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T20:21:31.904Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T20:21:50.898Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T20:37:52.526Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T20:37:53.638Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T20:37:54.373Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} {"severity":"INFO","time":"2023-01-05T21:14:11.890Z","correlation_id":null,"gitlab_throttle_user_allowlist":[]} ==> /var/log/gitlab/gitlab-rails/api_json.log <== # Logfile created on 2023-01-05 23:18:54 +0300 by logger.rb/v1.4.2 {"time":"2023-01-05T20:21:18.631Z","severity":"INFO","duration_s":0.01568,"db_duration_s":0.0,"view_duration_s":0.01568,"status":200,"method":"GET","path":"/api/v4/geo/proxy","params":[],"host":"localhost","remote_ip":"127.0.0.1","ua":"Go-http-client/1.1","route":"/api/:version/geo/proxy","db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.044849,"mem_objects":9967,"mem_bytes":3565968,"mem_mallocs":5172,"mem_total_bytes":3964648,"pid":764,"worker_id":"puma_3","rate_limiting_gates":[],"correlation_id":"ff142b93-77a7-4570-8207-71112d3a5b59","meta.caller_id":"GET /api/:version/geo/proxy","meta.remote_ip":"127.0.0.1","meta.feature_category":"geo_replication","meta.client_id":"ip/127.0.0.1","request_urgency":"low","target_duration_s":5} {"time":"2023-01-05T20:21:35.107Z","severity":"INFO","duration_s":0.00987,"db_duration_s":0.0,"view_duration_s":0.00987,"status":200,"method":"GET","path":"/api/v4/geo/proxy","params":[],"host":"localhost","remote_ip":"127.0.0.1","ua":"Go-http-client/1.1","route":"/api/:version/geo/proxy","db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.028582,"mem_objects":9967,"mem_bytes":3565968,"mem_mallocs":5172,"mem_total_bytes":3964648,"pid":771,"worker_id":"puma_6","rate_limiting_gates":[],"correlation_id":"59650f8f-3dc3-44dc-bc61-03480e874438","meta.caller_id":"GET /api/:version/geo/proxy","meta.remote_ip":"127.0.0.1","meta.feature_category":"geo_replication","meta.client_id":"ip/127.0.0.1","request_urgency":"low","target_duration_s":5} {"time":"2023-01-05T20:38:11.017Z","severity":"INFO","duration_s":0.01409,"db_duration_s":0.0,"view_duration_s":0.01409,"status":200,"method":"GET","path":"/api/v4/geo/proxy","params":[],"host":"localhost","remote_ip":"127.0.0.1","ua":"Go-http-client/1.1","route":"/api/:version/geo/proxy","db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.068369,"mem_objects":9966,"mem_bytes":3565968,"mem_mallocs":5172,"mem_total_bytes":3964608,"pid":658,"worker_id":"puma_10","rate_limiting_gates":[],"correlation_id":"05ed7892-a16d-45dc-9c9b-a80c714b80eb","meta.caller_id":"GET /api/:version/geo/proxy","meta.remote_ip":"127.0.0.1","meta.feature_category":"geo_replication","meta.client_id":"ip/127.0.0.1","request_urgency":"low","target_duration_s":5} ==> /var/log/gitlab/gitlab-rails/service_measurement.log <== # Logfile created on 2023-01-05 23:18:54 +0300 by logger.rb/v1.4.2 ==> /var/log/gitlab/gitlab-rails/production.log <== Redirected to http://gitlab/users/sign_in Completed 302 Found in 9ms (ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 6467) Started GET "/-/metrics" for 127.0.0.1 at 2023-01-06 00:29:55 +0300 Processing by MetricsController#index as HTML Completed 200 OK in 69ms (Views: 0.3ms | ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 2042) Started GET "/api/live/ws" for 192.168.128.1 at 2023-01-06 00:30:05 +0300 Processing by ApplicationController#route_not_found as HTML Parameters: {"unmatched_route"=>"api/live/ws"} Redirected to http://gitlab/users/sign_in Completed 302 Found in 13ms (ActiveRecord: 0.0ms | Elasticsearch: 0.0ms | Allocations: 6469) ==> /var/log/gitlab/gitlab-rails/database_load_balancing.log <== {"severity":"DEBUG","time":"2023-01-05T20:38:08.473Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} {"severity":"DEBUG","time":"2023-01-05T20:38:08.527Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} {"severity":"DEBUG","time":"2023-01-05T20:38:08.527Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} {"severity":"DEBUG","time":"2023-01-05T20:38:08.532Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} {"severity":"DEBUG","time":"2023-01-05T20:38:08.545Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} {"severity":"DEBUG","time":"2023-01-05T20:38:08.557Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} {"severity":"DEBUG","time":"2023-01-05T20:38:08.557Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} {"severity":"DEBUG","time":"2023-01-05T20:38:08.587Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} {"severity":"DEBUG","time":"2023-01-05T21:14:11.551Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":false} {"severity":"DEBUG","time":"2023-01-05T21:14:11.552Z","correlation_id":null,"event":"setup","model":"ActiveRecord::Base","start_service_discovery":true} ==> /var/log/gitlab/gitlab-rails/application_json.log <== {"severity":"DEBUG","time":"2023-01-05T21:21:06.386Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} {"severity":"DEBUG","time":"2023-01-05T21:21:06.386Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} {"severity":"DEBUG","time":"2023-01-05T21:21:06.386Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} {"severity":"DEBUG","time":"2023-01-05T21:21:06.386Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} {"severity":"DEBUG","time":"2023-01-05T21:21:06.386Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} {"severity":"INFO","time":"2023-01-05T21:21:06.386Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Finished sync of dynamic postgres partitions"} {"severity":"DEBUG","time":"2023-01-05T21:21:06.386Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} {"severity":"DEBUG","time":"2023-01-05T21:21:06.390Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} {"severity":"DEBUG","time":"2023-01-05T21:21:06.393Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} {"severity":"DEBUG","time":"2023-01-05T21:21:06.395Z","correlation_id":"0c4d4de5a38a2907974bbe901f54d465","message":"Switched database connection","connection_name":"main"} ==> /var/log/gitlab/gitlab-rails/production_json.log <== {"method":"GET","path":"/api/live/ws","format":"html","controller":"ApplicationController","action":"route_not_found","status":302,"location":"http://gitlab/users/sign_in","time":"2023-01-05T21:29:02.473Z","params":[{"key":"unmatched_route","value":"api/live/ws"}],"correlation_id":"01GP1XCQPZ24KX92FT3ZP2FGCQ","meta.caller_id":"ApplicationController#route_not_found","meta.remote_ip":"192.168.128.1","meta.client_id":"ip/192.168.128.1","remote_ip":"192.168.128.1","ua":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36","queue_duration_s":0.022775,"request_urgency":"default","target_duration_s":1,"redis_calls":14,"redis_duration_s":0.00203,"redis_read_bytes":2759,"redis_write_bytes":812,"redis_cache_calls":14,"redis_cache_duration_s":0.00203,"redis_cache_read_bytes":2759,"redis_cache_write_bytes":812,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_duration_s":0.002,"db_main_replica_duration_s":0.0,"cpu_s":0.036939,"mem_objects":16630,"mem_bytes":2475664,"mem_mallocs":4483,"mem_total_bytes":3140864,"pid":658,"worker_id":"puma_10","rate_limiting_gates":[],"db_duration_s":0.0,"view_duration_s":0.0,"duration_s":0.0127} {"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2023-01-05T21:29:10.241Z","params":[],"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.089173,"mem_objects":3257,"mem_bytes":1690040,"mem_mallocs":6450,"mem_total_bytes":1820320,"pid":646,"worker_id":"puma_4","rate_limiting_gates":[],"correlation_id":"32781e10-adf3-4b12-a403-1bb15a6e5e2b","db_duration_s":0.0,"view_duration_s":0.00028,"duration_s":0.08104} {"method":"GET","path":"/api/live/ws","format":"html","controller":"ApplicationController","action":"route_not_found","status":302,"location":"http://gitlab/users/sign_in","time":"2023-01-05T21:29:22.571Z","params":[{"key":"unmatched_route","value":"api/live/ws"}],"correlation_id":"01GP1XDB9V1X3VQT29X4Y5MKC8","meta.caller_id":"ApplicationController#route_not_found","meta.remote_ip":"192.168.128.1","meta.client_id":"ip/192.168.128.1","remote_ip":"192.168.128.1","ua":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36","queue_duration_s":0.059164,"request_urgency":"default","target_duration_s":1,"redis_calls":14,"redis_duration_s":0.003205,"redis_read_bytes":2759,"redis_write_bytes":812,"redis_cache_calls":14,"redis_cache_duration_s":0.003205,"redis_cache_read_bytes":2759,"redis_cache_write_bytes":812,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_duration_s":0.012,"db_main_replica_duration_s":0.0,"cpu_s":0.065819,"mem_objects":16635,"mem_bytes":2474928,"mem_mallocs":4478,"mem_total_bytes":3140328,"pid":644,"worker_id":"puma_3","rate_limiting_gates":[],"db_duration_s":0.0,"view_duration_s":0.0,"duration_s":0.01536} {"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2023-01-05T21:29:25.240Z","params":[],"redis_calls":3,"redis_duration_s":0.001591,"redis_read_bytes":608,"redis_write_bytes":206,"redis_cache_calls":3,"redis_cache_duration_s":0.001591,"redis_cache_read_bytes":608,"redis_cache_write_bytes":206,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.088824,"mem_objects":3800,"mem_bytes":1845544,"mem_mallocs":6714,"mem_total_bytes":1997544,"pid":650,"worker_id":"puma_6","rate_limiting_gates":[],"correlation_id":"aa94eb8d-0195-4520-8330-828388ef732b","db_duration_s":0.0,"view_duration_s":0.00028,"duration_s":0.07645} {"method":"GET","path":"/api/live/ws","format":"html","controller":"ApplicationController","action":"route_not_found","status":302,"location":"http://gitlab/users/sign_in","time":"2023-01-05T21:29:36.555Z","params":[{"key":"unmatched_route","value":"api/live/ws"}],"correlation_id":"01GP1XDS0BMMNJS44ZR3DJV8AA","meta.caller_id":"ApplicationController#route_not_found","meta.remote_ip":"192.168.128.1","meta.client_id":"ip/192.168.128.1","remote_ip":"192.168.128.1","ua":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36","queue_duration_s":0.016188,"request_urgency":"default","target_duration_s":1,"redis_calls":10,"redis_duration_s":0.00131,"redis_read_bytes":1949,"redis_write_bytes":552,"redis_cache_calls":10,"redis_cache_duration_s":0.00131,"redis_cache_read_bytes":1949,"redis_cache_write_bytes":552,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_duration_s":0.003,"db_main_replica_duration_s":0.0,"cpu_s":0.02862,"mem_objects":15884,"mem_bytes":2270816,"mem_mallocs":4129,"mem_total_bytes":2906176,"pid":650,"worker_id":"puma_6","rate_limiting_gates":[],"db_duration_s":0.0,"view_duration_s":0.0,"duration_s":0.0126} {"method":"GET","path":"/help","format":"*/*","controller":"HelpController","action":"index","status":200,"time":"2023-01-05T21:29:40.124Z","params":[],"correlation_id":"01GP1XDWEFP5ZSGDS4KDY8MF5W","meta.caller_id":"HelpController#index","meta.remote_ip":"127.0.0.1","meta.feature_category":"not_owned","meta.client_id":"ip/127.0.0.1","remote_ip":"127.0.0.1","ua":"curl/7.86.0-DEV","queue_duration_s":0.004689,"request_urgency":"default","target_duration_s":1,"redis_calls":8,"redis_duration_s":0.00124,"redis_read_bytes":751,"redis_write_bytes":1101,"redis_cache_calls":8,"redis_cache_duration_s":0.00124,"redis_cache_read_bytes":751,"redis_cache_write_bytes":1101,"db_count":6,"db_write_count":0,"db_cached_count":4,"db_replica_count":0,"db_primary_count":6,"db_main_count":6,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":4,"db_main_cached_count":4,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_duration_s":0.001,"db_main_replica_duration_s":0.0,"cpu_s":0.075661,"mem_objects":77983,"mem_bytes":15447888,"mem_mallocs":79807,"mem_total_bytes":18567208,"pid":650,"worker_id":"puma_6","rate_limiting_gates":[],"db_duration_s":0.00098,"view_duration_s":0.0631,"duration_s":0.06686} {"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2023-01-05T21:29:40.200Z","params":[],"redis_calls":3,"redis_duration_s":0.000442,"redis_read_bytes":608,"redis_write_bytes":206,"redis_cache_calls":3,"redis_cache_duration_s":0.000442,"redis_cache_read_bytes":608,"redis_cache_write_bytes":206,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_duration_s":0.0,"db_main_replica_duration_s":0.0,"cpu_s":0.050659,"mem_objects":3800,"mem_bytes":1845544,"mem_mallocs":6714,"mem_total_bytes":1997544,"pid":642,"worker_id":"puma_2","rate_limiting_gates":[],"correlation_id":"2145516e-44bd-43ea-8a8c-f4d6f78e32ed","db_duration_s":0.0,"view_duration_s":0.00024,"duration_s":0.04761} {"method":"GET","path":"/api/live/ws","format":"html","controller":"ApplicationController","action":"route_not_found","status":302,"location":"http://gitlab/users/sign_in","time":"2023-01-05T21:29:47.519Z","params":[{"key":"unmatched_route","value":"api/live/ws"}],"correlation_id":"01GP1XE3Q1JP062VQZBMVCVHCS","meta.caller_id":"ApplicationController#route_not_found","meta.remote_ip":"192.168.128.1","meta.client_id":"ip/192.168.128.1","remote_ip":"192.168.128.1","ua":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36","queue_duration_s":0.017246,"request_urgency":"default","target_duration_s":1,"redis_calls":14,"redis_duration_s":0.001712,"redis_read_bytes":2759,"redis_write_bytes":812,"redis_cache_calls":14,"redis_cache_duration_s":0.001712,"redis_cache_read_bytes":2759,"redis_cache_write_bytes":812,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":1,"db_main_count":1,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_duration_s":0.002,"db_main_replica_duration_s":0.0,"cpu_s":0.024195,"mem_objects":16633,"mem_bytes":2474800,"mem_mallocs":4476,"mem_total_bytes":3140120,"pid":654,"worker_id":"puma_8","rate_limiting_gates":[],"db_duration_s":0.0,"view_duration_s":0.0,"duration_s":0.00907} {"method":"GET","path":"/-/metrics","format":"html","controller":"MetricsController","action":"index","status":200,"time":"2023-01-05T21:29:55.237Z","params":[],"redis_calls":3,"redis_duration_s":0.002518,"redis_read_bytes":608,"redis_write_bytes":206,"redis_cache_calls":3,"redis_cache_duration_s":0.002518,"redis_cache_read_bytes":608,"redis_cache_write_bytes":206,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_replica_count":0,"db_primary_count":0,"db_main_count":0,"db_main_replica_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_main_cached_count":0,"db_main_replica_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_main_wal_count":0,"db_main_replica_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_main_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db ``` ### Details of package version ``` root@gitlab:/# dpkg-query -l "gitlab-*" Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-==============-============-============-=========================================================== ii gitlab-ce 15.7.0-ce.0 amd64 GitLab Community Edition (including NGINX, Postgres, Redis) un gitlab-ee <none> <none> (no description available) un gitlab-fips <none> <none> (no description available) ``` ### Environment details * Operating System: ubuntu 22.10 * Installation Target, remove incorrect values: * Other: docker (via docker-compose) * Installation Type, remove incorrect values: * New Installation * Resources * CPU: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz * Memory total: 65792128 ### Configuration details ``` root@gitlab:/# grep -v -e '^#' -e '^$' /etc/gitlab/gitlab.rb root@gitlab:/# ```
issue