Revert "Merge branch 'default-to-non-dry-run-for-relating-qa-failure-issues' into 'master'"

This reverts merge request !565 (merged)

The reporter was creating duplicate issues

/cc @rymai