Investigate unexpected spike in 5xx errors for ai-assisted requests

We experienced a spike of roughly 1k 500 and 503 errors for ai-assisted requests. These seemed to be related to the /api/:version/ai/code_suggestions/direct_access endpoint. While it is not sustained this isn't going to be kept as an open incident, however considering this impacted a number of users and the root cause is unclear, the team should investigate further to prevent any potential regressions.

https://dashboards.gitlab.net/goto/dfb0qk0redq80a?orgId=1

https://log.gprd.gitlab.net/app/r/s/upZic

This ticket was created from INC-6790 using incident.io 🔥