Custom targets for Error Budgets using Sisense

In the call last week, custom targets for Error Budget were discussed. The goal was to allow more flexibility to sections and groups to set error budget targets.

For the dashboards in Grafana, we need to keep the 99.95% target because this is aligned with the availability targets that we communicate with our customers and Infrastructure uses this to drive the monitoring systems.

Proposal

The Grafana dashboards are driven from the same data that is used to populate the Sisense dashboards, but the Sisense dashboards use an independent target that can be set at any level of granularity. The target is currently set on each chart, and edit rights are already granted on the Sisense dashboards.

The simplest and most boring solution is to change the targets used in the Sisense dashboards as this has no impact on monitoring. Then sections or groups can control their targets and change them independently.

At the same time, the Scalability team will continue to improve the maturity of the Error Budgets so that there is growing confidence to use that data for prioritization of reliability improvements.

The Grafana dashboards still contain relevant information that shows the most important endpoints to address, so we will leave these in place as is.