During reviewing of
https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/20806, it was
discovered that we don't cleaup stale config.lock files.

After this commit is released it will be part of general cleaup
procedures.