Present Lead time for MRs to be deployed to production in CI/CD dashboard - Ultimate
<!-- The first section "Release notes" is required if you want to have your release post blog MR auto generated. Currently piloting, details can be found in this issue: https://gitlab.com/gitlab-com/Product/-/issues/1392 and this video: https://www.youtube.com/watch?v=rfn9ebgTwKg The next four sections: "Problem to solve", "Intended users", "User experience goal", and "Proposal", are strongly recommended in your first draft, while the rest of the sections can be filled out during the problem validation or breakdown phase. However, keep in mind that providing complete and relevant information early helps our product team validate the problem and start working on a solution. --> ### Release notes <!-- What is the problem and solution you're proposing? This content sets the overall vision for the feature and serves as the release notes that will populate in various places, including the [release post blog](https://about.gitlab.com/releases/categories/releases/) and [Gitlab project releases](https://gitlab.com/gitlab-org/gitlab/-/releases). " --> ### Problem to solve <!-- What problem do we solve? Try to define the who/what/why of the opportunity as a user story. For example, "As a (who), I want (what), so I can (why/value)." --> As an executive investing in DevOps, I want to see my ROI. I want to see an improvement in the lead time for changes of my dev team. This will most likely drive the KPIs of my team. As a developer leader I want to see that the team is improving by measuring the lead for changes and comparing it over time (over sprints) ### Intended users <!-- Who will use this feature? If known, include any of the following: types of users (e.g. Developer), personas, or specific company roles (e.g. Release Manager). It's okay to write "Unknown" and fill this field in later. Personas are described at https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/ * [Cameron (Compliance Manager)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#cameron-compliance-manager) * [Parker (Product Manager)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#parker-product-manager) * [Delaney (Development Team Lead)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#delaney-development-team-lead) * [Presley (Product Designer)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#presley-product-designer) * [Sasha (Software Developer)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#sasha-software-developer) * [Devon (DevOps Engineer)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#devon-devops-engineer) * [Sidney (Systems Administrator)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#sidney-systems-administrator) * [Sam (Security Analyst)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#sam-security-analyst) * [Rachel (Release Manager)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#rachel-release-manager) * [Alex (Security Operations Engineer)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#alex-security-operations-engineer) * [Simone (Software Engineer in Test)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#simone-software-engineer-in-test) * [Allison (Application Ops)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#allison-application-ops) * [Priyanka (Platform Engineer)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#priyanka-platform-engineer) * [Dana (Data Analyst)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#dana-data-analyst) --> * [Parker (Product Manager)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#parker-product-manager) * [Delaney (Development Team Lead)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#delaney-development-team-lead) * [Rachel (Release Manager)](https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/#rachel-release-manager) ### User experience goal <!-- What is the single user experience workflow this problem addresses? For example, "The user should be able to use the UI/API/.gitlab-ci.yml with GitLab to <perform a specific task>" https://about.gitlab.com/handbook/engineering/ux/ux-research-training/user-story-mapping/ --> Today we show https://gitlab.com/gitlab-org/gitlab/-/value_stream_analytics ![image](/uploads/8ea3826e231c8dd3819838876ffca343/image.png) We already present number of commits as a numerical value under value stream analytics, we should show number of MRs as well, but we should show this in a chart view - as the trend is the most interesting aspect of this metric. ### Proposal <!-- How are we going to solve the problem? Try to include the user journey! https://about.gitlab.com/handbook/journeys/#user-journey --> We will present the **median** time it takes from when an MR is ready until it is merged into production (this does not include coding time) Days with zero deployments we will not show a period in the graph. Graph visualization (which will happen in %"13.11") would need a bit more UX input due to the opposite evaluation method than deployment frequencies. You can check the recording of the async call below. * Recording: https://youtu.be/NDwdGS3Q5E0 * GDoc: https://docs.google.com/document/d/1SAEFOslL6chD6_bZf7XYNZebJP-6qmj_EMR6lOzjkcY/edit?usp=sharing ![image](/uploads/842d5e074fdbc6c2335547055664b2a7/image.png) <details> <summary> 💎 Expand full design proposal </summary> --- - [Based on our design system docs](https://design.gitlab.com/data-visualization/charts/?path=%2Fstory%2Fcharts-chart--default#line-charts), using a line chart for time-series data like this is the right choice - We want to convey that periods with no MRs deployed have **no MTTM data available**, rather than **0 minutes of MTTM** - Depending on front-end limitations we might not be able to implement this exact design, but it's is a good starting point for this MVC | Option | Screenshot | Notes | | ------ | ------ | ------ | | 1 | ![mttm-1](/uploads/f1a3c615323ba2a3f5434282879e041a/mttm-1.png) | Clearly marks and labels periods with no data for users. **This is the version that will be developed** | | 2 | ![mttm-2](/uploads/56b25df77e8672f579c15376df1b3738/mttm-2.png) | Subtler version with less focus on "no data" periods | | 3 | ![mttm-3](/uploads/9be5d4d008952f4f5b4375a876ef7208/mttm-3.png) | Even simpler version that does not render anything for periods with no data (would be unable to open tooltip here without a visual target) | ##### Chart in page context We could also provide a toggled off option that entirely hides "no data" periods to show a seamless progression of MTTM. Note that even the dates are cut off from the chart here. ![image](/uploads/500f9e94dd00f061b4140ca8eb7160b7/image.png) Page loads with toggle ON by default: ![image](/uploads/49b2ec5cb8a066adb611117a5fefc211/image.png) Note: “View Data by [Day/Week]” dropdown will be implemented separately in https://gitlab.com/gitlab-org/gitlab/-/issues/326535 </details> <details> <summary>Further Details & References</summary> * Lead time for changes - how long does it take for code to be committed and reach production What this looks like in Cloudbees ![image](/uploads/0320f6723f45d185b4b2bb46ecbfdf55/image.png) What this looks like in Atlassian ![image](/uploads/7c3ffd40a2601cf4e96c33e0c76c3d8d/image.png) </details> <!-- Include use cases, benefits, goals, or any other details that will help us understand the problem better. --> ### Permissions and Security <!-- What permissions are required to perform the described actions? Are they consistent with the existing permissions as documented for users, groups, and projects as appropriate? Is the proposed behavior consistent between the UI, API, and other access methods (e.g. email replies)? Consider adding checkboxes and expectations of users with certain levels of membership https://docs.gitlab.com/ee/user/permissions.html * [ ] Add expected impact to members with no access (0) * [ ] Add expected impact to Guest (10) members * [ ] Add expected impact to Reporter (20) members * [ ] Add expected impact to Developer (30) members * [ ] Add expected impact to Maintainer (40) members * [ ] Add expected impact to Owner (50) members --> ### Documentation <!-- See the Feature Change Documentation Workflow https://docs.gitlab.com/ee/development/documentation/workflow.html#for-a-product-change * Add all known Documentation Requirements in this section. See https://docs.gitlab.com/ee/development/documentation/feature-change-workflow.html#documentation-requirements * If this feature requires changing permissions, update the permissions document. See https://docs.gitlab.com/ee/user/permissions.html --> ### Availability & Testing <!-- This section needs to be retained and filled in during the workflow planning breakdown phase of this feature proposal, if not earlier. What risks does this change pose to our availability? How might it affect the quality of the product? What additional test coverage or changes to tests will be needed? Will it require cross-browser testing? Please list the test areas (unit, integration and end-to-end) that needs to be added or updated to ensure that this feature will work as intended. Please use the list below as guidance. * Unit test changes * Integration test changes * End-to-end test change See the test engineering planning process and reach out to your counterpart Software Engineer in Test for assistance: https://about.gitlab.com/handbook/engineering/quality/test-engineering/#test-planning --> ### What does success look like, and how can we measure that? <!-- Define both the success metrics and acceptance criteria. Note that success metrics indicate the desired business outcomes, while acceptance criteria indicate when the solution is working correctly. If there is no way to measure success, link to an issue that will implement a way to measure this. --> ### What is the type of buyer? <!-- What is the buyer persona for this feature? See https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/buyer-persona/ In which enterprise tier should this feature go? See https://about.gitlab.com/handbook/product/pricing/#four-tiers --> ### Is this a cross-stage feature? <!-- Communicate if this change will affect multiple Stage Groups or product areas. We recommend always start with the assumption that a feature request will have an impact into another Group. Loop in the most relevant PM and Product Designer from that Group to provide strategic support to help align the Group's broader plan and vision, as well as to avoid UX and technical debt. https://about.gitlab.com/handbook/product/#cross-stage-features --> ~"devops::monitor" ~"devops::manage" ~"devops::release" ### Links / references * https://www.gocd.org/2018/11/30/deployment-frequency/ <!-- Label reminders - you should have one of each of the following labels if you can figure out the correct ones -->
issue