Skip to content

WIP: compressed batches

Igor requested to merge compressed-batches into master

Context for this change is in https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/10219.

This change implements the producer-side for compressed batches. This change has the potential to save up to 20x in logging volume (estimated from rails production_json.log).

Depends on two pending patches on pubsubbeat:

We'll either need to get those merged or maintain a fork that has the changes.

Merge request reports