500 ERROR when save any changes in admin area - settings: 13.4.3
Summary
after update gitlab (13.3.7 ce) from debian installation to docker installation (13.4.3-ce.0) I got error 500 when I try to save any changes on admin area: for example:
Steps to reproduce
import a backup from debian installation 13.3.7 ce on docker installation -> restart docker installation with 13.4.3 -> go to admin area -> settings -> preference -> help page : do some changes -> save
Relevant logs and/or screenshots
==> /var/log/gitlab/gitlab-rails/production.log <== Started PATCH "/admin/application_settings/preferences" for 172.21.22.41 at 2020-10-19 14:47:18 +0000 Processing by Admin::ApplicationSettingsController#preferences as HTML Parameters: {"utf8"=>"✓", "authenticity_token"=>"[FILTERED]", "application_setting"=>{"help_page_text"=>"p", "help_page_hide_commercial_content"=>"[FILTERED]", "help_page_support_url"=>""}} Completed 500 Internal Server Error in 71ms (ActiveRecord: 37.3ms | Elasticsearch: 0.0ms | Allocations: 21496)
==> /var/log/gitlab/gitlab-rails/production_json.log <==
{"method":"PATCH","path":"/admin/application_settings/preferences","format":"html","controller":"Admin::ApplicationSettingsController","action":"preferences","status":500,"time":"2020-10-19T14:47:18.510Z","params":[{"key":"utf8","value":"✓"},{"key":"_method","value":"patch"},{"key":"authenticity_token","value":"[FILTERED]"},{"key":"application_setting","value":{"help_page_text":"p","help_page_hide_commercial_content":"[FILTERED]","help_page_support_url":""}}],"remote_ip":"172.21.22.41","user_id":1,"username":"root","ua":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.75 Safari/537.36","correlation_id":"sgG63HXN3p2","meta.user":"root","meta.caller_id":"Admin::ApplicationSettingsController#preferences","redis_calls":5,"redis_duration_s":0.0007639999999999999,"redis_read_bytes":1142,"redis_write_bytes":1675,"redis_cache_calls":4,"redis_cache_duration_s":0.000578,"redis_cache_read_bytes":811,"redis_cache_write_bytes":234,"redis_shared_state_calls":1,"redis_shared_state_duration_s":0.000186,"redis_shared_state_read_bytes":331,"redis_shared_state_write_bytes":1441,"cpu_s":0.04,"exception.class":"OpenSSL::Cipher::CipherError","exception.message":"","exception.backtrace":["lib/gitlab/crypto_helper.rb:27:in aes256_gcm_decrypt'","app/models/concerns/token_authenticatable_strategies/encrypted.rb:45:in
get_token'","app/models/concerns/token_authenticatable_strategies/base.rb:27:in ensure_token'","app/models/concerns/token_authenticatable_strategies/encrypted.rb:32:in
ensure_token'","app/models/concerns/token_authenticatable.rb:43:in block in add_authentication_token_field'","app/services/application_settings/update_service.rb:40:in
execute'","app/controllers/admin/application_settings_controller.rb:240:in perform_update'","app/controllers/admin/application_settings_controller.rb:31:in
block (2 levels) in class:ApplicationSettingsController'","app/controllers/application_controller.rb:491:in set_current_admin'","lib/gitlab/session.rb:11:in
with_session'","app/controllers/application_controller.rb:482:in set_session_storage'","lib/gitlab/i18n.rb:73:in
with_locale'","lib/gitlab/i18n.rb:79:in with_user_locale'","app/controllers/application_controller.rb:476:in
set_locale'","lib/gitlab/error_tracking.rb:52:in with_context'","app/controllers/application_controller.rb:541:in
sentry_context'","app/controllers/application_controller.rb:469:in block in set_current_context'","lib/gitlab/application_context.rb:52:in
block in use'","lib/gitlab/application_context.rb:52:in use'","lib/gitlab/application_context.rb:20:in
with_context'","app/controllers/application_controller.rb:462:in set_current_context'","lib/gitlab/request_profiler/middleware.rb:17:in
call'","lib/gitlab/jira/middleware.rb:19:in call'","lib/gitlab/middleware/go.rb:20:in
call'","lib/gitlab/etag_caching/middleware.rb:13:in call'","lib/gitlab/middleware/multipart.rb:217:in
call'","lib/gitlab/middleware/read_only/controller.rb:51:in call'","lib/gitlab/middleware/read_only.rb:18:in
call'","lib/gitlab/middleware/same_site_cookies.rb:27:in call'","lib/gitlab/middleware/basic_health_check.rb:25:in
call'","lib/gitlab/middleware/handle_ip_spoof_attack_error.rb:25:in call'","lib/gitlab/middleware/request_context.rb:23:in
call'","config/initializers/fix_local_cache_middleware.rb:9:in call'","lib/gitlab/metrics/requests_rack_middleware.rb:60:in
call'","lib/gitlab/middleware/release_env.rb:12:in `call'"],"db_duration_s":0.0373,"view_duration_s":0.0,"duration_s":0.07143,"db_count":0,"db_write_count":0,"db_cached_count":0}
Output of checks
Expand for output related to the GitLab application check
gitlab-rake gitlab:check SANITIZE=true Checking GitLab subtasks ...
Checking GitLab Shell ...
GitLab Shell: ... GitLab Shell version >= 13.7.0 ? ... OK (13.7.0) Running /opt/gitlab/embedded/service/gitlab-shell/bin/check Internal API available: OK Redis available via internal API: OK gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Gitaly ...
Gitaly: ... default ... OK
Checking Gitaly ... Finished
Checking Sidekiq ...
Sidekiq: ... Running? ... yes Number of Sidekiq processes ... 1
Checking Sidekiq ... Finished
Checking Incoming Email ...
Incoming Email: ... Reply by email is disabled in config/gitlab.yml
Checking Incoming Email ... Finished
Checking LDAP ...
LDAP: ... Server: ldapmain LDAP authentication... Success LDAP users with access to your GitLab server (only showing the first 100 results) User output sanitized. Found 55 users of 100 limit.
Checking LDAP ... Finished
Checking GitLab App ...
Git configured correctly? ... yes Database config exists? ... yes All migrations up? ... yes Database contains orphaned GroupMembers? ... no GitLab config exists? ... yes GitLab config up to date? ... yes Log directory writable? ... yes Tmp directory writable? ... yes Uploads directory exists? ... yes Uploads directory has correct permissions? ... yes Uploads directory tmp has correct permissions? ... yes Init script exists? ... skipped (omnibus-gitlab has no init script) Init script up-to-date? ... skipped (omnibus-gitlab has no init script) Projects have namespace: ... 1/1 ... yes 1/2 ... yes 1/3 ... yes 1/4 ... yes 1/5 ... yes 1/6 ... yes 2/8 ... yes 2/9 ... yes 12/10 ... yes 12/11 ... yes 12/12 ... yes 4/13 ... yes 13/14 ... yes 4/15 ... yes 12/16 ... yes 12/17 ... yes 4/18 ... yes 2/19 ... yes 13/20 ... yes 12/21 ... yes 15/22 ... yes 12/23 ... yes 12/24 ... yes 9/25 ... yes 4/26 ... yes 24/27 ... yes 24/28 ... yes 24/29 ... yes 24/30 ... yes 24/31 ... yes 24/32 ... yes 24/33 ... yes 24/34 ... yes 24/35 ... yes 24/36 ... yes 24/37 ... yes 28/38 ... yes 28/39 ... yes 24/40 ... yes 28/41 ... yes 28/42 ... yes 24/45 ... yes 24/46 ... yes 24/47 ... yes 24/48 ... yes 24/49 ... yes 24/51 ... yes 24/53 ... yes 24/54 ... yes 24/55 ... yes 28/56 ... yes 24/57 ... yes 12/58 ... yes 12/59 ... yes 24/60 ... yes 24/61 ... yes 24/62 ... yes 24/63 ... yes 24/64 ... yes 24/65 ... yes 28/66 ... yes 24/67 ... yes 24/68 ... yes 24/71 ... yes 24/72 ... yes 24/77 ... yes 23/82 ... yes 24/83 ... yes 24/84 ... yes 35/87 ... yes 24/88 ... yes 24/89 ... yes 24/90 ... yes 24/91 ... yes 24/92 ... yes 24/93 ... yes 24/94 ... yes 24/95 ... yes 24/96 ... yes 24/97 ... yes 24/99 ... yes 35/100 ... yes 24/101 ... yes 24/102 ... yes 35/103 ... yes 35/104 ... yes 35/106 ... yes 47/111 ... yes 47/112 ... yes 24/113 ... yes 28/115 ... yes 43/116 ... yes 24/117 ... yes 43/118 ... yes 42/119 ... yes 43/123 ... yes 43/124 ... yes 43/125 ... yes 43/126 ... yes 43/128 ... yes 51/129 ... yes 53/133 ... yes 43/134 ... yes 54/135 ... yes 24/136 ... yes 54/137 ... yes 29/138 ... yes 24/139 ... yes 24/140 ... yes 54/141 ... yes 1/142 ... yes 54/143 ... yes 24/144 ... yes 24/147 ... yes 64/148 ... yes 54/149 ... yes 54/150 ... yes 54/151 ... yes 54/152 ... yes 54/153 ... yes 54/154 ... yes 67/155 ... yes 43/156 ... yes 56/157 ... yes 56/158 ... yes 56/159 ... yes 56/160 ... yes 56/161 ... yes 56/162 ... yes 56/163 ... yes 51/165 ... yes 54/166 ... yes 55/171 ... yes 67/172 ... yes 43/173 ... yes 54/174 ... yes 78/176 ... yes 81/177 ... yes 80/178 ... yes 76/179 ... yes 43/181 ... yes Redis version >= 4.0.0? ... yes Ruby version >= 2.5.3 ? ... yes (2.6.6) Git version >= 2.24.0 ? ... yes (2.28.0) Git user has default SSH configuration? ... yes Active users: ... 53 Is authorized keys file accessible? ... yes GitLab configured to store new projects in hashed storage? ... yes All projects are in hashed storage? ... yes
Checking GitLab App ... Finished
Checking GitLab subtasks ... Finished
Results of GitLab environment info
Expand for output related to GitLab environment info
gitlab-rake gitlab:env:info System information System: Current User: git Using RVM: no Ruby Version: 2.6.6p146 Gem Version: 2.7.10 Bundler Version:1.17.3 Rake Version: 12.3.3 Redis Version: 5.0.9 Git Version: 2.28.0 Sidekiq Version:5.2.9 Go Version: unknown GitLab information Version: 13.4.3 Revision: 6689552c479 Directory: /opt/gitlab/embedded/service/gitlab-rails DB Adapter: PostgreSQL DB Version: 11.9 URL: https://gitlabtest02.intra.lne HTTP Clone URL: https://gitlabtest02.intra.lne/some-group/some-project.git SSH Clone URL: ssh://git@gitlabtest02.intra.lne:2222/some-group/some-project.git Using LDAP: yes Using Omniauth: yes Omniauth Providers: GitLab Shell Version: 13.7.0 Repository storage paths: - default: /opt/git-data/repositories GitLab Shell path: /opt/gitlab/embedded/service/gitlab-shell Git: /opt/gitlab/embedded/bin/git