[META] Logging at GitLab.com
As part of a conversation started in https://gitlab.com/gitlab-com/infrastructure/issues/1729 we should be discussing the ideal architecture for the logging platform.
Points that should be a topic:
- Having a dedicated logging vnet for production and/or staging
- Having separated logging setups for each environment
- Having different rsyslog services (internal and external)
- Consider a replacement for rsyslog (fluentd/filebeat) to transform and parse logs locally on each node so there is not extra overhead on the logstash side