Increase message limit to 100
What does this merge request do and why?
- Previous limit was 10, which was set via this MR
- In the monolith, we save up to 50 Duo Chat messages.
- Message history is sent with each request to the AI Gateway. We send the user prompt and the Duo Chat answer for each item in the history.
- We either need to change the amount of history we send from the monolith or the message limit in the Gateway.
- More discussion on history / context window limits here: gitlab-org/gitlab#444629 (comment 1838552224)
How to set up and validate locally
- Check out to this merge request's branch.
- Check out the branch for the monolith on this branch.
- Make 5+ Duo Chat requests
- Can make a 6th Duo chat request.
- On the
main
branch of the AI Gateway, the 6th request includes the following in the response:
"ctx\\\":{\\\"field_type\\\":\\\"List\\\",\\\"max_length\\\":10,\\\"actual_length\\\":11},\\\"url\\\":\\\"https://errors.pydantic.dev/2.6/v/too_long\\\"
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Merge request reports
Activity
assigned to @jessieay
added devopsai-powered sectiondata-science labels
Maintainer roulette
To spread load more evenly across eligible maintainers, Danger has picked a candidate for each review slot. Feel free to override these selections if you think someone else would be better-suited or use the GitLab Review Workload Dashboard to find other available maintainers.
To read more on how to use the maintainer roulette, please take a look at the Engineering workflow and code review guidelines.
Once you've decided who will review this merge request, mention them as you normally would! Danger does not automatically notify them for you.
Maintainer @achueshev
(UTC+2, 9 hours ahead of author)
If needed, you can retry the
🔁 danger-review
job that generated this comment.Generated by
🚫 Dangerremoved devopsai-powered sectiondata-science labels
added devopsai-powered sectiondata-science labels
- Resolved by Shinya Maeda
- Resolved by Shinya Maeda
Hi @shinya.maeda - thoughts on this MR? We either need to change the AI Gateway to accept more messages or we need to allow fewer chat history messages to be sent from the monolith to the AI Gateway.
requested review from @shinya.maeda
mentioned in issue gitlab-org/gitlab#452608
enabled an automatic merge when the pipeline for 5a3403c5 succeeds
mentioned in commit dc236f7d
changed milestone to %16.11
mentioned in issue #426 (closed)