Code Review Analytics considering bot comments when it shouldn't
Summary
Code Review Analytics measures the start of code review as being the first comment by a non-author. However, it is currently considering bot comments to be the first comment, which was not intended. Code review should be considered to start at the first non-author comment by a human.
Steps to reproduce
- Configure a bot to auto-comment on merge requests after they are opened.
- Open a merge request and wait for the bot to comment.
- Visit the Code Review Analytics feature (/*groups/project/-/analytics/code_reviews) and see that code review is considered to have begun on your MR.
What is the current bug behavior?
Bot comments are considered the start of code review.
What is the expected correct behavior?
Bot comments are not considered the start of code review.
Relevant logs and/or screenshots
Example from the gitlab project:
Output of checks
This bug happens on GitLab.com
Possible fixes
- Identify users as bots or humans, and ignore bot comments for purposes of calculating the start of code review.