Why people are not using Review apps?
After completing out user interviews for review apps, one of the recommendations was to perform a research with non review apps users, to understand why they aren't using them
What’s this issue all about?
- Identify the roadblocks to using Review Apps
Who is the target user of the feature?
- non Review apps users
What questions are you trying to answer?
- Why aren't users using review apps
Core questions
- Is it important for you to see your implemented changes before deploying to production?
- yes
- no
- Do you know what a review app is? [see comment below]
- yes
- no
- I'm not sure
- Do you know that GitLab offers Review App functionality?
- yes
- no
- I'm not sure
- How do you test changes in the code before they reach production? (choose all that apply)
- testing/staging/preproduction environment
- Dynamic environment built for the commit/merge request
- Call someone to view changes on developer's PC
- Take screenshots and/or send page layouts via emails and similar
- Test in production
- Other (text)
- Which Review Apps solution are you using?
- GitLab
- Heruko
- Scalingo
- Azure DevOps
- None
- Other (text)
- Why did you choose this tool?
- Price
- Easy to set up
- Continued free trial
- Other (text)
- Why do you continue to use this solution? (choose all that apply)
- easy to use
- Reliable
- Works well
- Price
- Hard to migrate
- I didn't know there were alternatives
- Other (text)
- Have you tried to setup GitLab Review Apps? [don't show if they are using GL review apps]
- yes
- no
- I'm not sure
- Where would you expect Review Apps to be located?
- Under the merge request
- Under environments
- Under Settings
- Under Operations
- Under CI/CD
- Other (text)
- Do you know that you can comment on the review app itself and that the comment will be added to the merge request?
- yes
- no
- I'm not sure
- What would make you use GitLab Review Apps? [see comment below]
- Easy to use
- Easy to setup
- Reliable
- Works well
- Price
- Other (text)
- Are there problems with the current functionality that blocks you from using Review Apps? see comment below
- yes
- no
- In order for a review app to be a successful part of your workflow, who needs access to the review app? (choose all that apply)
- Developers
- DevOps Engineers
- Product Managers
- QA Engineers
- Product Designers
- Project Managers
- Executives
- Sales Engineers
- Customer Support
- Customers
- Others (text)
- How likely are you to use review apps? [see comment below]
- Very Likely
- Maybe
- Not Likely
- Is there any missing functionality to the feature? [see comment below]
Additional questions
What hypotheses and/or assumptions do you have?
- Setup is complicated so users are giving up
- Users don't know about Review Apps and therefore are not using them
What decisions will you make based on the research findings?
- If we understand the gaps, we can address them and get more users to use review apps
- Fix existing capabilities, improve documentation, prioritize missing features
When do you need this research to be completed? (Milestone or date)
12.8
Edited by Lorie Whitaker