Instrument CI Authoring Funnel: First Green Pipeline
Problem to solve
Today we are unsure of the success rate of customers attempting to author CI yaml files and get to their new project's first green build. This means our prioritization of improvements to the authoring process related to this metric aren't guided by product data.
Intended users
- GitLab Product Managers
- GitLab Developers
- GitLab Community Contributors
Proposal
Record, for every project that has not already run a pipeline and is not using Auto DevOps:
- The date and time the first pipeline is run
- A count of each time a pipeline runs (inclusive of the one above), until the first time a pipeline succeeds
- The date and time the first time a pipeline succeeds
We would need some kind of sisense dashboard that shows how this is trending over time.
Examples
If a person has a success their first try, and their build runs for 10 minutes, the data would look something like the following (YAML is used here just for illustration purposes):
my_project:
first_run: 2020-06-01 10:00AM PST
count: 1
first_success: 2020-06-01 10:10AM PST
Someone who has been trying different things for a month with no success would look something like the following:
my_other_project:
first_run: 2020-01-03 9:30AM PST
count: 54
first_success: false
Technical proposal
we can have a table like ci_project_pipeline_statistics
, and store the data in it.