Remove last remnants of github-linguist gem

In the previous release we stopped using the github-linguist gem completely, so now it's safe to remove the last remnants of it.

Closes: #4635 (closed)