[build] Avoid `gofumpt` Lint Noise

Currently gofumpt writes every file name from git ls-files to stderr on each run, this avoids that.