Skip to content

AI-Powered stage lead issue - FY26Q2 - Agentic Chat feedback

Issue

gitlab-org/gitlab#542198

UI/UX Issues

  1. Progress Indication Problems

    • No clear progress bar or indicator showing when Duo is working
    • Difficult to determine if the agent is still processing or has stopped/crashed
    • Sometimes appears to be waiting for input when it's actually still working
  2. Interaction Challenges

    • Stop button terminates the entire workflow and loses context
    • No way to "soft interrupt" the agent without losing conversation history
    • Input field sometimes enabled while agent is still performing tasks
    • Moving chat window to secondary sidebar causes reset
  3. Visual and Interface Issues

    • Text size appears out of scale with the rest of VS Code
    • Clickable file links in chat don't function when clicked
    • Copy to clipboard button doesn't preserve markdown formatting

Performance Issues

  1. Agent Getting Stuck

    • Frequently gets stuck in loops of "finding answer"
    • Sometimes never completes tasks, even after an hour
    • Sometimes errors out with no clear indication
  2. Speed Concerns

    • Slow compared to competitors (mentioned Cline/Cursor)
    • Takes "ages" for file creation (5+ minutes in one example)

Functionality Gaps

  1. Context Awareness

    • Unaware of current selection, current file, and open tabs
    • Doesn't match Classic Chat behavior of including selected code as context
  2. File Handling

    • Creates new files instead of modifying existing ones
    • No visual indication when files are created
    • No automatic opening of created files in VS Code
  3. API Limitations

    • Pagination not considered when fetching issues
    • Cannot create issues in GitLab (only creates local text files)
    • Doesn't work on newly created local folders or non-GitLab projects

Positive Feedback

  1. Helpful for Non-Developers

    • Levels the playing field for those without developer backgrounds
    • Helped with MR contributions to Compliance Frameworks feature
  2. Issue Analysis

    • Provided useful categorization of issues (e.g., "Most Significant Issues", "Performance and Reliability Issues")
    • Helpful for answering customer queries with code pointers

Suggestions for Improvement

  1. Better File Management

    • Show a list of file changes that updates as they're made
    • Make file links clickable to open in preview/diff view
  2. Improved Interaction

    • Add ability to interrupt without losing context
    • Show thinking but collapse most of it to avoid overwhelming the chat
    • Clearer indication when agent is working vs. waiting for input
  3. Better Context Awareness

    • Include current file as context
    • Include open tabs as context
    • Match Classic Chat behavior for selected code

Sources: Feedback on experimental GitLab Duo Agentic Chat