Response 500 after upgrade 14.8.2

Summary

Steps to reproduce

After upgrade from 13.12.15 -14.0.11 - 14.1.8 - 14.2.6 - 14.7.3 -> 14.8.2

Example Project

What is the current bug behavior?

What is the expected correct behavior?

I got 500 response after just view/edit .gitlab-ci.yml file (Other files are fine, i can view .gitlab-ci.yml in CI/CD settings)

Relevant logs and/or screenshots

Started GET "/vtpmbcore/vtpmbwebadmin/-/blob/master/.gitlab-ci.yml" for 192.168.10.9 at 2022-03-07 15:13:38 +0700
Processing by Projects::BlobController#show as HTML
  Parameters: {"namespace_id"=>"vtpmbcore", "project_id"=>"vtpmbwebadmin", "id"=>"master/.gitlab-ci.yml"}
  Rendered layout layouts/project.html.haml (Duration: 79.1ms | Allocations: 19368)
Completed 500 Internal Server Error in 164ms (ActiveRecord: 29.8ms | Elasticsearch: 0.0ms | Allocations: 33250)
ActionView::Template::Error (bad decrypt):
    17:   - title = _("Replace %{blob_name}") % { blob_name: @blob.name }
    18:   = render 'projects/blob/upload', title: title, placeholder: title, button_title: _('Replace file'), form_path: project_update_blob_path(@project, @id), method: :put
    19:
    20: = render partial: 'pipeline_tour_success' if show_suggest_pipeline_creation_celebration?
    21: = render 'shared/web_ide_path'

app/models/concerns/ci/has_variable.rb:44:in `uncached_runner_variable'
app/models/concerns/ci/has_variable.rb:38:in `block in to_runner_variable'
lib/gitlab/safe_request_store.rb:12:in `fetch'
app/models/concerns/ci/has_variable.rb:38:in `to_runner_variable'
app/models/concerns/ci/maskable.rb:22:in `to_runner_variable'
lib/gitlab/ci/variables/collection/item.rb:62:in `fabricate'
lib/gitlab/ci/variables/collection.rb:20:in `append'
lib/gitlab/ci/variables/collection.rb:34:in `block (2 levels) in concat'
lib/gitlab/ci/variables/collection.rb:34:in `each'
lib/gitlab/ci/variables/collection.rb:34:in `block in concat'
lib/gitlab/ci/variables/collection.rb:34:in `tap'
lib/gitlab/ci/variables/collection.rb:34:in `concat'
lib/gitlab/ci/config.rb:162:in `block in build_variables_without_instrumentation'
lib/gitlab/ci/config.rb:152:in `tap'
lib/gitlab/ci/config.rb:152:in `build_variables_without_instrumentation'
lib/gitlab/ci/config.rb:144:in `block in build_variables'
lib/gitlab/ci/pipeline/logger.rb:27:in `instrument'
lib/gitlab/ci/config.rb:143:in `build_variables'
lib/gitlab/ci/config.rb:138:in `build_context'
lib/gitlab/ci/config.rb:27:in `block in initialize'
lib/gitlab/ci/pipeline/logger.rb:27:in `instrument'
lib/gitlab/ci/config.rb:26:in `initialize'
lib/gitlab/ci/yaml_processor.rb:23:in `new'
lib/gitlab/ci/yaml_processor.rb:23:in `execute'
lib/gitlab/ci/lint.rb:73:in `block in yaml_processor_result'
lib/gitlab/ci/pipeline/logger.rb:27:in `instrument'
lib/gitlab/ci/lint.rb:69:in `yaml_processor_result'
lib/gitlab/ci/lint.rb:56:in `static_validation'
lib/gitlab/ci/lint.rb:33:in `validate'
app/models/blob_viewer/gitlab_ci_yml.rb:20:in `validation_message'
app/models/blob_viewer/gitlab_ci_yml.rb:24:in `valid?'
app/helpers/blob_helper.rb:383:in `show_suggest_pipeline_creation_celebration?'
app/views/projects/blob/show.html.haml:20
app/controllers/application_controller.rb:133:in `render'
app/controllers/projects/blob_controller.rb:243:in `show_html'
app/controllers/projects/blob_controller.rb:68:in `block (2 levels) in show'
app/controllers/projects/blob_controller.rb:66:in `show'
app/controllers/application_controller.rb:541:in `block in allow_gitaly_ref_name_caching'
lib/gitlab/gitaly_client.rb:321:in `allow_ref_name_caching'
app/controllers/application_controller.rb:540:in `allow_gitaly_ref_name_caching'
app/controllers/application_controller.rb:490:in `set_current_admin'
lib/gitlab/session.rb:11:in `with_session'
app/controllers/application_controller.rb:481:in `set_session_storage'
lib/gitlab/i18n.rb:105:in `with_locale'
lib/gitlab/i18n.rb:111:in `with_user_locale'
app/controllers/application_controller.rb:475:in `set_locale'
app/controllers/application_controller.rb:469:in `set_current_context'
lib/gitlab/metrics/elasticsearch_rack_middleware.rb:16:in `call'
lib/gitlab/middleware/rails_queue_duration.rb:33:in `call'
lib/gitlab/middleware/memory_report.rb:13:in `call'
lib/gitlab/middleware/speedscope.rb:13:in `call'
lib/gitlab/request_profiler/middleware.rb:17:in `call'
lib/gitlab/database/load_balancing/rack_middleware.rb:23:in `call'
lib/gitlab/metrics/rack_middleware.rb:16:in `block in call'
lib/gitlab/metrics/web_transaction.rb:46:in `run'
lib/gitlab/metrics/rack_middleware.rb:16:in `call'
lib/gitlab/jira/middleware.rb:19:in `call'
lib/gitlab/middleware/go.rb:20:in `call'
lib/gitlab/etag_caching/middleware.rb:21:in `call'
lib/gitlab/middleware/multipart.rb:173:in `call'
lib/gitlab/middleware/read_only/controller.rb:50:in `call'
lib/gitlab/middleware/read_only.rb:18:in `call'
lib/gitlab/middleware/same_site_cookies.rb:27:in `call'
lib/gitlab/middleware/handle_malformed_strings.rb:21:in `call'
lib/gitlab/middleware/basic_health_check.rb:25:in `call'
lib/gitlab/middleware/handle_ip_spoof_attack_error.rb:25:in `call'
lib/gitlab/middleware/request_context.rb:21:in `call'
lib/gitlab/middleware/webhook_recursion_detection.rb:15:in `call'
config/initializers/fix_local_cache_middleware.rb:11:in `call'
lib/gitlab/middleware/compressed_json.rb:26:in `call'
lib/gitlab/middleware/rack_multipart_tempfile_factory.rb:19:in `call'
lib/gitlab/middleware/sidekiq_web_static.rb:20:in `call'
lib/gitlab/metrics/requests_rack_middleware.rb:77:in `call'
lib/gitlab/middleware/release_env.rb:13:in `call'

Output of checks

Results of GitLab environment info

Expand for output related to GitLab environment info

System information
System:         Ubuntu 20.04
Current User:   git
Using RVM:      no
Ruby Version:   2.7.5p203
Gem Version:    3.1.4
Bundler Version:2.1.4
Rake Version:   13.0.6
Redis Version:  6.2.6
Sidekiq Version:6.4.0
Go Version:     unknown

GitLab information
Version:        14.8.2
Revision:       c7be43f6dd3
Directory:      /opt/gitlab/embedded/service/gitlab-rails
DB Adapter:     PostgreSQL
DB Version:     12.10
URL:            https://git.viettelpost.vn
HTTP Clone URL: https://git.viettelpost.vn/some-group/some-project.git
SSH Clone URL:  git@git.viettelpost.vn:some-group/some-project.git
Using LDAP:     no
Using Omniauth: yes
Omniauth Providers:

GitLab Shell
Version:        13.23.2
Repository storage paths:
- default:      /data/gitlab/git-data/repositories
GitLab Shell path:              /opt/gitlab/embedded/service/gitlab-shell

Results of GitLab application Check

Expand for output related to the GitLab application check

root@devbachnt:~# sudo gitlab-rake gitlab:check SANITIZE=true
Checking GitLab subtasks ...
Checking GitLab Shell ...
GitLab Shell: ... GitLab Shell version >= 13.23.2 ? ... OK (13.23.2)
Running /opt/gitlab/embedded/service/gitlab-shell/bin/check
Internal API available: OK
Redis available via internal API: OK
gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Gitaly ...
Gitaly: ... default ... OK
Checking Gitaly ... Finished
Checking Sidekiq ...
Sidekiq: ... Running? ... yes
Number of Sidekiq processes (cluster/worker) ... 1/1
Checking Sidekiq ... Finished
Checking Incoming Email ...
Incoming Email: ... Reply by email is disabled in config/gitlab.yml
Checking Incoming Email ... Finished
Checking LDAP ...
LDAP: ... LDAP is disabled in config/gitlab.yml
Checking LDAP ... Finished
Checking GitLab App ...
Database config exists? ... yes
All migrations up? ... yes
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config up to date? ... yes
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory exists? ... yes
Uploads directory has correct permissions? ... yes
Uploads directory tmp has correct permissions? ... yes
Systemd unit files or init script exist? ... skipped (omnibus-gitlab has neither init script nor systemd units)
Systemd unit files or init script up-to-date? ... skipped (omnibus-gitlab has neither init script nor systemd units)
Projects have namespace: ...
2/1 ... yes
4/2 ... yes
4/3 ... yes
12/4 ... yes
12/5 ... yes
12/6 ... yes
10/7 ... yes
10/9 ... yes
10/10 ... yes
10/11 ... yes
10/12 ... yes
10/14 ... yes
2/15 ... yes
2/16 ... yes
18/17 ... yes
18/20 ... yes
20/21 ... yes
20/22 ... yes
17/23 ... yes
2/24 ... yes
24/25 ... yes
2/26 ... yes
12/27 ... yes
10/28 ... yes
10/30 ... yes
2/31 ... yes
2/33 ... yes
2/34 ... yes
2/35 ... yes
18/36 ... yes
18/37 ... yes
163/38 ... yes
35/42 ... yes
35/44 ... yes
35/45 ... yes
42/46 ... yes
42/47 ... yes
42/48 ... yes
42/49 ... yes
42/50 ... yes
42/51 ... yes
42/52 ... yes
42/54 ... yes
42/55 ... yes
2/56 ... yes
42/57 ... yes
42/58 ... yes
42/59 ... yes
42/60 ... yes
42/61 ... yes
42/62 ... yes
42/63 ... yes
42/64 ... yes
42/65 ... yes
42/66 ... yes
42/67 ... yes
42/68 ... yes
42/69 ... yes
42/70 ... yes
44/71 ... yes
44/72 ... yes
44/73 ... yes
42/74 ... yes
35/75 ... yes
35/76 ... yes
114/78 ... yes
114/79 ... yes
114/80 ... yes
24/81 ... yes
42/82 ... yes
51/83 ... yes
51/85 ... yes
51/86 ... yes
51/87 ... yes
51/88 ... yes
52/89 ... yes
52/90 ... yes
48/91 ... yes
42/92 ... yes
42/93 ... yes
64/95 ... yes
67/96 ... yes
42/99 ... yes
42/100 ... yes
18/101 ... yes
35/102 ... yes
35/103 ... yes
48/104 ... yes
59/105 ... yes
68/106 ... yes
64/107 ... yes
47/108 ... yes
10/109 ... yes
69/110 ... yes
35/143 ... yes
35/144 ... yes
36/145 ... yes
36/146 ... yes
35/147 ... yes
2/148 ... yes
2/149 ... yes
18/150 ... yes
75/151 ... yes
42/152 ... yes
74/154 ... yes
81/156 ... yes
75/157 ... yes
67/158 ... yes
20/159 ... yes
18/160 ... yes
18/162 ... yes
42/164 ... yes
35/165 ... yes
47/166 ... yes
75/168 ... yes
42/169 ... yes
42/170 ... yes
18/171 ... yes
18/172 ... yes
91/173 ... yes
10/174 ... yes
21/175 ... yes
35/180 ... yes
35/181 ... yes
89/182 ... yes
114/183 ... yes
115/184 ... yes
42/185 ... yes
3/186 ... yes
117/187 ... yes
117/188 ... yes
20/189 ... yes
75/190 ... yes
42/191 ... yes
18/192 ... yes
18/193 ... yes
7/195 ... yes
7/196 ... yes
113/197 ... yes
42/198 ... yes
50/201 ... yes
50/203 ... yes
18/204 ... yes
9/205 ... yes
35/206 ... yes
125/208 ... yes
119/209 ... yes
125/210 ... yes
127/211 ... yes
127/212 ... yes
127/213 ... yes
127/214 ... yes
127/215 ... yes
81/217 ... yes
35/218 ... yes
136/220 ... yes
139/221 ... yes
67/222 ... yes
69/224 ... yes
117/225 ... yes
35/226 ... yes
35/227 ... yes
81/228 ... yes
35/229 ... yes
35/232 ... yes
136/233 ... yes
144/234 ... yes
145/235 ... yes
7/238 ... yes
146/239 ... yes
147/241 ... yes
144/242 ... yes
35/243 ... yes
18/244 ... yes
136/245 ... yes
67/246 ... yes
36/247 ... yes
91/249 ... yes
125/250 ... yes
150/251 ... yes
114/252 ... yes
151/253 ... yes
125/255 ... yes
18/257 ... yes
18/258 ... yes
5/259 ... yes
149/260 ... yes
154/261 ... yes
9/264 ... yes
154/265 ... yes
154/266 ... yes
154/267 ... yes
154/268 ... yes
42/269 ... yes
160/270 ... yes
2/271 ... yes
7/272 ... yes
7/273 ... yes
18/275 ... yes
163/276 ... yes
163/277 ... yes
163/278 ... yes
163/279 ... yes
163/280 ... yes
163/281 ... yes
163/282 ... yes
163/283 ... yes
163/284 ... yes
163/285 ... yes
18/291 ... yes
148/292 ... yes
2/293 ... yes
163/294 ... yes
166/295 ... yes
139/296 ... yes
2/297 ... yes
163/298 ... yes
42/299 ... yes
7/301 ... yes
91/302 ... yes
163/303 ... yes
91/304 ... yes
91/305 ... yes
136/306 ... yes
18/307 ... yes
166/308 ... yes
35/309 ... yes
2/310 ... yes
18/311 ... yes
35/312 ... yes
84/314 ... yes
84/315 ... yes
73/316 ... yes
2/317 ... yes
91/319 ... yes
42/320 ... yes
91/322 ... yes
170/323 ... yes
163/325 ... yes
117/326 ... yes
170/327 ... yes
170/328 ... yes
170/329 ... yes
147/330 ... yes
173/331 ... yes
2/332 ... yes
9/333 ... yes
170/335 ... yes
154/336 ... yes
170/337 ... yes
170/338 ... yes
148/340 ... yes
139/342 ... yes
170/343 ... yes
20/344 ... yes
2/345 ... yes
2/346 ... yes
181/347 ... yes
2/348 ... yes
185/349 ... yes
185/350 ... yes
185/351 ... yes
185/352 ... yes
185/353 ... yes
185/354 ... yes
136/355 ... yes
210/356 ... yes
42/357 ... yes
91/358 ... yes
186/360 ... yes
187/361 ... yes
188/362 ... yes
69/363 ... yes
42/364 ... yes
170/365 ... yes
91/366 ... yes
42/368 ... yes
91/369 ... yes
91/370 ... yes
91/371 ... yes
136/372 ... yes
182/374 ... yes
136/377 ... yes
181/378 ... yes
181/379 ... yes
10/380 ... yes
30/381 ... yes
10/382 ... yes
192/384 ... yes
192/385 ... yes
192/386 ... yes
11/387 ... yes
154/388 ... yes
196/392 ... yes
10/393 ... yes
69/395 ... yes
91/397 ... yes
2/398 ... yes
192/401 ... yes
192/402 ... yes
192/403 ... yes
42/404 ... yes
201/406 ... yes
42/407 ... yes
202/409 ... yes
202/410 ... yes
202/411 ... yes
202/412 ... yes
202/413 ... yes
202/414 ... yes
202/415 ... yes
202/416 ... yes
136/417 ... yes
192/418 ... yes
139/419 ... yes
179/420 ... yes
69/421 ... yes
2/422 ... yes
9/423 ... yes
10/424 ... yes
136/425 ... yes
192/427 ... yes
178/428 ... yes
2/429 ... yes
207/430 ... yes
204/431 ... yes
204/432 ... yes
91/433 ... yes
197/434 ... yes
207/438 ... yes
192/439 ... yes
91/440 ... yes
207/441 ... yes
210/442 ... yes
211/443 ... yes
192/444 ... yes
192/445 ... yes
215/446 ... yes
192/448 ... yes
192/449 ... yes
197/452 ... yes
193/453 ... yes
138/454 ... yes
2/455 ... yes
2/456 ... yes
139/457 ... yes
2/458 ... yes
192/459 ... yes
10/460 ... yes
220/461 ... yes
221/462 ... yes
139/463 ... yes
214/465 ... yes
209/467 ... yes
177/468 ... yes
69/469 ... yes
10/470 ... yes
177/472 ... yes
192/473 ... yes
10/474 ... yes
163/475 ... yes
10/476 ... yes
138/477 ... yes
2/478 ... yes
225/479 ... yes
163/481 ... yes
210/482 ... yes
91/483 ... yes
138/484 ... yes
192/486 ... yes
183/487 ... yes
2/488 ... yes
192/489 ... yes
193/491 ... yes
232/492 ... yes
209/493 ... yes
10/494 ... yes
42/495 ... yes
236/498 ... yes
236/499 ... yes
236/500 ... yes
183/501 ... yes
18/502 ... yes
237/503 ... yes
209/504 ... yes
11/505 ... yes
85/506 ... yes
209/508 ... yes
246/510 ... yes
246/511 ... yes
246/512 ... yes
339/513 ... yes
197/514 ... yes
190/515 ... yes
192/516 ... yes
227/517 ... yes
227/518 ... yes
197/519 ... yes
192/520 ... yes
255/521 ... yes
246/522 ... yes
10/523 ... yes
192/525 ... yes
192/526 ... yes
42/527 ... yes
10/528 ... yes
197/529 ... yes
236/530 ... yes
10/532 ... yes
193/533 ... yes
224/534 ... yes
192/535 ... yes
192/536 ... yes
197/537 ... yes
183/538 ... yes
265/541 ... yes
176/542 ... yes
10/543 ... yes
236/544 ... yes
209/545 ... yes
236/547 ... yes
236/548 ... yes
236/549 ... yes
192/550 ... yes
195/551 ... yes
192/552 ... yes
236/554 ... yes
209/556 ... yes
278/557 ... yes
192/558 ... yes
182/559 ... yes
182/560 ... yes
192/561 ... yes
183/562 ... yes
234/563 ... yes
209/564 ... yes
182/565 ... yes
221/567 ... yes
293/568 ... yes
293/569 ... yes
293/570 ... yes
2/571 ... yes
277/572 ... yes
179/573 ... yes
42/574 ... yes
234/575 ... yes
182/576 ... yes
236/577 ... yes
293/578 ... yes
9/579 ... yes
10/580 ... yes
243/581 ... yes
271/582 ... yes
183/583 ... yes
209/585 ... yes
302/587 ... yes
302/588 ... yes
303/589 ... yes
302/590 ... yes
282/591 ... yes
209/592 ... yes
192/593 ... yes
282/594 ... yes
289/595 ... yes
293/596 ... yes
182/597 ... yes
10/598 ... yes
2/599 ... yes
293/600 ... yes
293/601 ... yes
11/602 ... yes
182/603 ... yes
312/608 ... yes
313/609 ... yes
313/610 ... yes
10/611 ... yes
317/612 ... yes
317/613 ... yes
317/614 ... yes
312/615 ... yes
10/616 ... yes
133/617 ... yes
10/618 ... yes
9/619 ... yes
10/620 ... yes
305/623 ... yes
293/624 ... yes
228/625 ... yes
228/626 ... yes
293/627 ... yes
305/628 ... yes
293/629 ... yes
293/630 ... yes
10/631 ... yes
309/632 ... yes
179/633 ... yes
326/635 ... yes
197/636 ... yes
324/638 ... yes
69/639 ... yes
10/640 ... yes
265/641 ... yes
10/642 ... yes
265/643 ... yes
293/644 ... yes
293/645 ... yes
42/646 ... yes
330/649 ... yes
293/650 ... yes
10/651 ... yes
42/652 ... yes
293/654 ... yes
293/655 ... yes
327/656 ... yes
333/657 ... yes
333/658 ... yes
333/659 ... yes
130/660 ... yes
305/662 ... yes
9/663 ... yes
10/664 ... yes
10/665 ... yes
339/666 ... yes
Redis version >= 5.0.0? ... yes
Ruby version >= 2.7.2 ? ... yes (2.7.5)
Git user has default SSH configuration? ... yes
Active users: ... 121
Is authorized keys file accessible? ... yes
GitLab configured to store new projects in hashed storage? ... yes
All projects are in hashed storage? ... yes
Checking GitLab App ... Finished
Checking GitLab subtasks ... Finished

Possible fixes

Rollback "db_key_base" gitlab_rails now works