group::organizations - HTTP 500 errors from DB statement timeout

Summary

On 2025-01-10, users for a GitLab Dedicated customer reported in support ticket (Internal only) on spike in HTTP 500 errors when making requests to the following endpoints, with the exception message PG::QueryCanceled: ERROR: canceling statement due to statement timeout. Dedicated SRE assessed that it was not an infrastructure issue and likely an application bug.

This bug report was created on the advice of groupdatabase frameworks out of this Request for Help issue (Internal only), for product to review the endpoints and their SQL to identify the cause of the DB statement timeout.

meta.caller_id	feature_category	exception.class
GET /api/:version/groups/:id/projects	groups_and_projects	ActiveRecord::QueryCanceled
GET /api/:version/projects	groups_and_projects	ActiveRecord::QueryCanceled
GroupsController#show	groups_and_projects	ActionView::Template::Error
Projects::AutocompleteSourcesController#members	groups_and_projects	ActiveRecord::QueryCanceled
RootController#index	user_profile	ActiveRecord::QueryCanceled & ActionView::Template::Error
UsersController#calendar	user_profile	ActiveRecord::QueryCanceled
GET /api/:version/users	user_profile	ActiveRecord::QueryCanceled
UserSettings::SshKeysController#revoke	user_profile ?	ActiveRecord::QueryCanceled

Relevant logs and/or screenshots

SQL queries can be found in this Google Sheets: link (Internal only).

Output of checks

This bug happens on GitLab Dedicated

Possible fixes