Internal Developer Testing for Duo Context Feature

Objective

Conduct unmoderated testing sessions with internal developers to evaluate the effectiveness and user experience of the context feature Duo IDE

Background

We need to gather more data on how developers interact with and utilize the context feature in real-world scenarios. This will help us identify potential issues, understand user workflows, and improve the overall user experience.

Methodology

  1. Create unmoderated tests using UserTesting platform
  2. Recruit internal developers as participants
  3. Have participants use Duo context feature to complete a task in their IDE
  4. Have participants record their screens and think aloud while completing tasks using the context feature
  5. Collect and analyze the recorded sessions

Test Setup

  • Create the test in UserTesting
  • Use links to invite internal users to participate
  • @nicollem to provide test content and structure

Participant Recruitment

  • @bvenker will rally internal developers to participate in the study

Key Areas to Explore

  1. Effectiveness of the context feature in maintaining conversational context
  2. Impact on developer efficiency and context switching
  3. Integration with workflows involving multiple files
  4. Overall user experience and performance

Deliverables

  1. Recorded sessions of developers using the context feature
  2. Summary of findings and insights
  3. Recommendations for feature improvements

Future Considerations

  • Conduct moderated sessions for deeper exploration of specific issues or hypotheses
  • Expand testing to external developers if needed

CC: @katiemacoy @NickHertz

Please update this issue with any additional information or changes to the plan.