Skip to content

Upload diagnostics logs to ES

John Skarbek requested to merge jts/diag-logs into master
  • All webservice containers run a side car container that periodically uploads diagnostic data to GCS
  • This container spits out logs, let's capture those
  • These logs will start off as non-JSON formatted but once the container begins running the uploader script, all output is JSON formatted
  • Since this is specific to rails, I figured we'd reuse the same index for rails
  • Since this container does not run the gitlab-logger, we do not have a necessary filter for easy searching so we leverage the same field for subcomponent that gitlab-logger leverages to ensure this becomes easier to filter for
  • Note that we lose which type our logs are for with the way that this change is set up 😬
    • If we want to fix this, we'd need to create an entry for each workload

Addresses: gitlab-org/gitlab#381447 (closed)

Merge request reports