Add offset to recording rules in the recording rule registry
In #2478 (comment 1519299290) we have noticed that adding an offset to recording rules that are used in SLIs (sli_aggregations:*
) can avoid race conditions between recording a numerator and denominator in separate rules causing the values to not match. The mismatch is caused by having a rate at a slightly different time, or when not all metrics are available at the time the recording rule evaluates.
Adding a 30s offset to the queries works around this problem.
Edited by Bob Van Landuyt