Add logging behind feature flag

What does this MR do and why?

We need a way to toggle this just in case and we don't need it enabled by default to self-managed instances.

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.