Upgrade fluentd to recent version

Currently the gitlab_fluentd cookbook installs td-agent 4.0.1-1: https://gitlab.com/gitlab-cookbooks/gitlab_fluentd/-/blob/3cfd55578f119956dfdf3462c516ddf63c7cea6a/attributes/default.rb#L8

td-agent 4.0.1-1 ships with fluentd 1.11.2, which runs Ruby 2.7.1.

td-agent has been renamed to fluent-package. fluent-package v5 ships with Ruby 3.2.4, which has significant memory and CPU improvements. Details of v4 to v5 are here:

• https://docs.fluentd.org/quickstart/fluent-package-v5-vs-td-agent
• https://github.com/fluent/fluent-package-builder/blob/master/CHANGELOG.md#release-v500---20230728

From https://gitlab.com/gitlab-com/gl-infra/dbre/-/issues/221.

To upgrade, we need to:

1. Rename the recipes/filenames to use fluent-package and associated binaries
2. Update package signing key
3. Validate the plugins still work with fleuentd v1.16.2

Details

• Point of contact for this request: @user
• If a call is needed, what is the proposed date and time of the call: Date and Time
• Additional call details (format, type of call): additional details

SRE Support Needed Support Request Details