Discrepancy between Thanos recording rule and underlying query
Originally from #2264 (comment 1369564914). @msmiley noticed apdex ratios being more than 1 in https://gitlab.com/gitlab-com/gl-infra/scalability/uploads/17eb3220684035585ecf3eaab7c4450c/Screenshot_from_2023-04-26_16-56-56.png.
Digging deeper, he found that the denominator of the apdex calculations gitlab_component_apdex:weight:score_5m
, differed from the underlying query for redis-cluster-ratelimiting
service.
/cc @reprazent @msmiley
Some similar issues on thanos github
Edited by Sylvester Chin