Unable to remove a forked project that has LFS objects

First reported by @jramsay in gitlab-com/support-forum#2833.

See https://gitlab.com/gitlab-com/support-forum/issues/2833#note_51870453 for more details.

/cc: @reprazent