Create dashboards for pipeline tiers transitions
Context
In this chart, we're monitoring the transitions from predictive pipelines (soon to become tier-1 pipelines) to full pipelines (soon to be tier-2+ pipelines).
We would to expand this monitoring to other tiers we'll create.
Goal
Create dashboards in Snowflake to monitor the following tiers transitions:
- tier 1 -> tier 2
- tier 2 -> tier 3
- tier 1 -> tier 3
Some other ideas:
- Number of pipelines per tier
- Distribution of Tiers (70% tier 1, …). Not necessarily by MRs
- Percentage of failed/successful pipelines per tier
- Percentile durations of successful pipelines per tier
- Table with two pipeline URLs:
success in tier N
→failure in tier N+1
Technical considerations
We first need two issues to be done before we start this one:
With those two issues, we'll then be able to see pipeline from a given tier by scanning their names (SQL field is XXX
)
EDIT: Currently, Snowflake doesn't have the pipeline name in the pipelines table. I asked in Slack (internal) whether we could add it.
Edited by David Dieulivol