Feedback and monitoring for e2e:perf-on-cng job integration in GitLab MR pipelines

Overview

This issue tracks feedback, monitoring, and improvements for the e2e:perf-on-cng job, currently allowed to fail, that has been integrated into GitLab merge request pipelines as part of Enabling Performance tests on MRs with CPT (gitlab-org/gitlab!197705 - merged).

Background

From the Enabling Performance tests on MRs with CPT (gitlab-org/gitlab!197705 - merged)

The e2e:perf-on-cng job enables performance testing on merge requests by:

Testing two key API endpoints: GET /api/:version/projects/:id/merge_requests GET /api/:version/groups/:id/merge_requests Running as a child job of test-on-cng Providing performance regression detection for MR changes

Purpose

This issue serves as a central place to:

• Collect feedback from developers and reviewers about the job's impact on MR workflows
• Effectiveness on highlighting performance anomalies
• Monitor performance and reliability of the job itself
• Track issues and improvements needed for the integration
• Document learnings from real-world usage

What to report here

Please comment on this issue if you experience:

• ❌ Job failures or unexpected behavior
• ⏱️ Performance issues with the job execution time
• 🔄 Workflow disruptions caused by the performance tests
• 💡 Suggestions for improving the job and making it efficient
• 📊 False positives/negatives in performance regression detection
• Success stories if any related to this job highlighting performance issue in MR

Success metrics

We'll be monitoring:

• Job success rate and execution time
• Impact on overall MR pipeline duration
• Effectiveness in catching/highlighting performance anomalies

Related links

• Original MR: gitlab-org/gitlab!197705 (merged)
• Related epic/issue: #25 (closed)

---

This is an ongoing feedback collection issue. Please keep comments focused on the e2e:perf-on-cng job specifically.