Investigate adding annotations for Chef role changes to Grafana

Corrective action from https://gitlab.com/gitlab-com/gl-infra/infrastructure/issues/8528