setup.cfg: Fix xdg env vars to not affect the host
Description
!1244 (merged) was not strict enough with its isolation, leaving a few cases where environments variable could still affect our tests.
This tightens the overrides to ensure we are not affected by user's environment.