Consider Prefills in the Assistant Role if in Use
DuoChat is still returning a large quantity of empty set responses - {}
This issue only appears to be affecting Issue/Epic, and affects about 20% of the responses.
Could this response be the result of Claude response prefills? These prefills can be used to constrain Claude's output.
answering_model |
question |
answer_from_answering_model |
duo-chat | what is this issue about? | {} |
duo-chat | what is this issue about? | {} |
duo-chat | Could you summarize this issue | {} |
duo-chat | what is this issue about? | {} |
duo-chat | what is this issue about? | {} |
duo-chat | Summarize this Issue. | {} |
duo-chat | Summarize this Issue. | {} |
duo-chat | Could you summarize this issue | {} |
duo-chat |
gitlab-org/gitlab#371038 (closed) - Summarize this issue |
{} |
duo-chat |
gitlab-org/gitlab#371038 (closed) - Summarize this issue |
{} |
duo-chat |
How much work is left to be done gitlab-org&10550 ? |
{} |
duo-chat | Summarize the comments into bullet points? | {} |
duo-chat |
How much work is left to be done gitlab-org&10550 ? |
{} |
duo-chat | Summarize this issue | {} |
duo-chat |
Are there any open questions relating to this issue? gitlab-org/gitlab#17800 (closed) |
{} |
duo-chat |
Are there any open questions relating to this issue? gitlab-org/gitlab#371038 (closed) |
{} |
Edited by Susie Bitters