fix: CS post process and prompt builder block the server process
What does this merge request do and why?
fix: CS post process and prompt builder blocks the server process
This commit fixes the performance issue that the Code Suggestion's post processing and prompt building are currently blocking the server process.
Related to https://gitlab.com/gitlab-com/gl-infra/production/-/issues/17366 #405 (closed)
How to set up and validate locally
Numbered steps to set up and validate the change are strongly suggested.
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Edited by Shinya Maeda