Empty file diff in MR should not give users the ability to expand/collapse

This was seen in gitlab-build-images!128 (merged) before I created a new commit to paste the changes, the UI is in a different state after that push.