setup.cfg: Fix xdg env vars to not affect the host

Description

!1244 (merged) was not strict enough with its isolation, leaving a few cases where environments variable could still affect our tests.

This tightens the overrides to ensure we are not affected by user's environment.