DuoChat emptying assistant answer unpredictably when answer is streaming in
Every once in a while, DuoChat would incorrectly handle the answers it was streaming. Although it displayed them correctly as they were being received, once the streaming completed, it would "forget" the received message. It would then remove the message from the DOM and display an empty message instead.
Demo Video |
---|
duo-chat |
It is possible to reproduce on production fairly consistently with find me the gitlab-org/gitlab issue that is about the API not being able to tell us which subscription the user has
as a prompt.
It doesn't have the exact same behavior locally as on prod, but we should still be able to try the prompt adjustments.
Technical notes
Please see these logs for more information.
Note the hallucination ... it is referencing issue '#12345 (closed)'
We should experiment with adding something like "You are not able to search for issues based on a description. You can only answer if you are given a specific issue." to the IssueIdentifier
prompt