Reduce the number of PubSub topics for fluentd-archiver to subscribe to
Part of https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/13991
We only need fluent-archiver
to handle the logs pushed from Kubernetes from our custom Fluentd deployment, the rest is already handled well by Stackdriver, and some of those other topics (system
, gke-audit
) are not very well handled by the current configuration because of missing a time(stamp) field.
See also https://ops.gitlab.net/gitlab-com/gitlab-com-infrastructure/-/merge_requests/2961
Edited by Pierre Guinoiseau