Collect feedback on natural language querying feature

Collecting quick user feedback on natural language querying can be done via Internal Events. It would make a great addition to the existing Product Analytics dashboard.

Prototype Duo Chat user feedback design
image

Source: User feedback on chat response not saved (#421858 - closed)

Proposal

Give a one-click way for a user to provide feedback on whether the query/visualization powered by Duo was helpful, unhelpful, or flat-out wrong.

Potential options for event instrumentation:

  1. Send distinct custom events for each button click, e.g., feedback_nlq_thumbsup, feedback_nlq_thumbsdown, feedback_nlq_wrong (currently supported)
  2. Send the type of feedback as a property in a singular feedback event (supported via Custom Event property support - Product Analytics (&11962 - closed) and Additional Internal event properties on Frontend (#434505 - closed))
Potential ideas for where to put feedback after visualization has loaded from a Duo-generated query

Screenshot_2024-02-15_at_09.25.37

Resources:

Figma file (this is combined with the related issue (or the 'manual prompt' as I refer to it below): https://www.figma.com/file/hkxGARlVfBH3UJ3LLvhbmC/Feedback-prompt-after-visualization-creation?type=design&node-id=0%3A1&mode=design&t=JMhHrynNujNeWPFn-1

Designs

Generate with Duo result shown After feedback
image image

Implementation plan

frontend 2️⃣

  • Create a new visualization feedback component that:
    • Matches the layout of the design above.
    • Takes in a prompt ID and sends this with the user submitted feedback.
      • Save feedback as custom events, e.g., feedback_nlq_thumbsup, feedback_nlq_thumbsdown, feedback_nlq_wrong
      • After submitting, display the thank you message.
    • Watches for promptId changes and on change shows the initial feedback layout.
  • Render this component inline with the button group and aligned right in the designer preview.
    • On small viewports vertically collapse the section so that the feedback component is above the button group.
  • Add specs.
Edited by Jiaan Louw