Don't delete required artifacts when tracking is enabled

Tristan Van Berkomrequested to merge
tristan/fix-required-artifacts-1.2 into bst-1.2

Backport of !793 (merged)

Merge request reports