Add ability to run E2E tests against gitlab foss
What does this MR do and why?
Add ability to run E2E tests in gitlab CE mode
Closes #398206 (closed)
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Merge request reports
Activity
assigned to @acunskis
- A deleted user
added frontend label
2 Warnings 
93edfa04: The commit subject must contain at least 3 words. For more information, take a look at our Commit message guidelines. e48abd04: The commit subject must contain at least 3 words. For more information, take a look at our Commit message guidelines. Pipeline Changes
This merge request contains changes to the pipeline configuration for the GitLab project.
Please consider the effect of the changes in this merge request on the following:
- Effects on different pipeline types
- Effects on non-canonical projects:
gitlab-fosssecuritydev- personal forks
- Effects on pipeline performance
Please consider communicating these changes to the broader team following the communication guideline for pipeline changes
Reviewer roulette
Changes that require review have been detected!
Please refer to the table below for assigning reviewers and maintainers suggested by Danger in the specified category:
Category Reviewer Maintainer frontend Ammar Alakkad (
@aalakkad) (UTC+3, 4 hours behind@acunskis)Miguel Rincon (
@mrincon) (UTC+2, 5 hours behind@acunskis)maintenanceworkflow / maintenancepipelines for CI, Danger Jerry Seto (
@j.seto) (UTC-4, 11 hours behind@acunskis)Stan Hu (
@stanhu) (UTC-7, 14 hours behind@acunskis)Engineering Productivity Reviewer review is optional for Engineering Productivity Jennifer Li (
@jennli) (UTC-7, 14 hours behind@acunskis)To spread load more evenly across eligible reviewers, Danger has picked a candidate for each review slot, based on their timezone. Feel free to override these selections if you think someone else would be better-suited or use the GitLab Review Workload Dashboard to find other available reviewers.
To read more on how to use the reviewer roulette, please take a look at the Engineering workflow and code review guidelines. Please consider assigning a reviewer or maintainer who is a domain expert in the area of the merge request.
Once you've decided who will review this merge request, assign them as a reviewer! Danger does not automatically notify them for you.
If needed, you can retry the
danger-reviewjob that generated this comment.Generated by
Edited by Ghost Useradded Quality maintenancepipelines typemaintenance labels
changed milestone to %15.11
Allure report
allure-report-publishergenerated test report!e2e-review-qa:
expand test summary
+-----------------------------------------------------------------------+ | suites summary | +------------------+--------+--------+---------+-------+-------+--------+ | | passed | failed | skipped | flaky | total | result | +------------------+--------+--------+---------+-------+-------+--------+ | Framework sanity | 9 | 0 | 1 | 0 | 10 | ✅ | | Data Stores | 22 | 0 | 0 | 0 | 22 | ✅ | | Plan | 49 | 0 | 1 | 0 | 50 | ✅ | | Create | 28 | 0 | 1 | 0 | 29 | ✅ | | Govern | 26 | 0 | 0 | 0 | 26 | ✅ | | Manage | 8 | 0 | 3 | 0 | 11 | ✅ | | Verify | 10 | 0 | 0 | 0 | 10 | ✅ | | Monitor | 4 | 0 | 0 | 0 | 4 | ✅ | | Package | 0 | 0 | 1 | 0 | 1 | ➖ | +------------------+--------+--------+---------+-------+-------+--------+ | Total | 156 | 0 | 7 | 0 | 163 | ✅ | +------------------+--------+--------+---------+-------+-------+--------+e2e-package-and-test:
expand test summary
+-----------------------------------------------------------------------+ | suites summary | +------------------+--------+--------+---------+-------+-------+--------+ | | passed | failed | skipped | flaky | total | result | +------------------+--------+--------+---------+-------+-------+--------+ | Package | 126 | 0 | 59 | 61 | 185 | ❗ | | Manage | 203 | 1 | 32 | 60 | 236 | ❌ | | Systems | 19 | 0 | 0 | 0 | 19 | ✅ | | Create | 749 | 0 | 112 | 291 | 861 | ❗ | | GitLab Metrics | 2 | 0 | 1 | 0 | 3 | ✅ | | Analytics | 11 | 0 | 0 | 8 | 11 | ❗ | | Verify | 270 | 0 | 20 | 237 | 290 | ❗ | | Plan | 312 | 0 | 0 | 95 | 312 | ❗ | | Fulfillment | 12 | 0 | 110 | 0 | 122 | ✅ | | Secure | 20 | 0 | 40 | 15 | 60 | ❗ | | Release | 30 | 0 | 0 | 22 | 30 | ❗ | | Govern | 235 | 0 | 0 | 201 | 235 | ❗ | | Data Stores | 185 | 0 | 3 | 56 | 188 | ❗ | | Configure | 1 | 0 | 15 | 0 | 16 | ✅ | | Monitor | 61 | 1 | 1 | 52 | 63 | ❌ | | Growth | 0 | 0 | 10 | 0 | 10 | ➖ | | Framework sanity | 0 | 0 | 7 | 0 | 7 | ➖ | | ModelOps | 0 | 0 | 5 | 0 | 5 | ➖ | +------------------+--------+--------+---------+-------+-------+--------+ | Total | 2236 | 2 | 415 | 1098 | 2653 | ❌ | +------------------+--------+--------+---------+-------+-------+--------+e2e-package-and-test-ce:
expand test summary
+-----------------------------------------------------------------------+ | suites summary | +------------------+--------+--------+---------+-------+-------+--------+ | | passed | failed | skipped | flaky | total | result | +------------------+--------+--------+---------+-------+-------+--------+ | Verify | 230 | 0 | 10 | 0 | 240 | ✅ | | Create | 502 | 10 | 85 | 0 | 597 | ❌ | | Manage | 125 | 1 | 32 | 0 | 158 | ❌ | | Data Stores | 155 | 0 | 0 | 0 | 155 | ✅ | | Monitor | 44 | 10 | 0 | 0 | 54 | ❌ | | Plan | 124 | 0 | 0 | 0 | 124 | ✅ | | Release | 25 | 0 | 0 | 0 | 25 | ✅ | | Analytics | 11 | 0 | 0 | 0 | 11 | ✅ | | Configure | 1 | 0 | 10 | 0 | 11 | ✅ | | Package | 125 | 0 | 59 | 0 | 184 | ✅ | | Framework sanity | 0 | 0 | 5 | 0 | 5 | ➖ | | Systems | 19 | 0 | 0 | 0 | 19 | ✅ | | GitLab Metrics | 2 | 0 | 1 | 0 | 3 | ✅ | +------------------+--------+--------+---------+-------+-------+--------+ | Total | 1363 | 21 | 202 | 0 | 1586 | ❌ | +------------------+--------+--------+---------+-------+-------+--------+Edited by Ghost User
Resolved by Rémy Coutable@balasankarc Do You have any idea how hard it would be to adjust
omnibusproject to be able to build CE image using the code fromgitlab-org/gitlab? Right now it seems it will always default to trying to fetch code fromfossproject if we passee: false.We would like to add ability to run tests against CE instance from mr and also move nightly e2e test runs in to gitlab project given it already has a nightly schedule as well.
- Last reply by Andrejs Cunskis
-
cc: @rymai This would work and we could move nightly e2e jobs in to gitlab but we need to figure out how to build ce images on omnibus side, it currently doesn't support it properly (it will fetch correct frontend assets but it is not fetching backend code from this project)
added 244 commits
-
43548bfc...1b254a78 - 237 commits from branch
master - 14f2d188 - Add assets build in ce mode
- c50eb19d - Add package-and-test CE trigger job
- 7a6012f4 - Add custom name for package and test pipelines
- 75a16738 - Fetch correct assets hash
- f70353da - Override gitlab repo when building CE image
- d745db1d - Add missing dependency on trigger omnibus
- dcc7f99b - Remove needs block from qa jobs
Toggle commit list-
43548bfc...1b254a78 - 237 commits from branch
mentioned in merge request omnibus-gitlab!6803 (merged)
