Skip to content
Snippets Groups Projects

Add job for custom tests

Merged Mark Lapierre requested to merge ml-add-job-for-custom-scenario-tests into master
All threads resolved!

Adds a manual job that lets you specify the scenario, release, tests, and tags, allowing you to run any tests on demand.

  • QA_SCENARIO - the scenario to run (default Test::Instance::Image)
  • QA_TESTS - the test(s) to run (no default, which means run all the tests in the scenario)
  • QA_RSPEC_TAGS - the RSpec tags to add (no default)

Useful if you want to run a specific test a few times, or a subset of tests in a particular order.


Update: Unfortunately, this isn’t as useful as intended because for now it’s not possible to retry the job with the custom variables

Edited by Mark Lapierre

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Mark Lapierre resolved all threads

    resolved all threads

  • Mark Lapierre added 1 commit

    added 1 commit

    • 0698cf85 - Apply suggestion to .gitlab-ci.yml

    Compare with previous version

  • Mark Lapierre resolved all threads

    resolved all threads

  • Mark Lapierre added 1 commit

    added 1 commit

    • c4325e1e - Apply suggestion to .gitlab-ci.yml

    Compare with previous version

  • Author Maintainer

    To test I set RELEASE to registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee-qa:6601069bbe422156c75839c03e54b57c8f9cc4b8 and QA_TESTS to qa/specs/features/ee/browser_ui/6_release/multi-project_pipelines_spec.rb and it passed the values to rspec via docker via gitlab-qa as expected: https://gitlab.com/gitlab-org/gitlab-qa/-/jobs/389384446

    ...-name gitlab-ee-qa-4f9685d1 registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee-qa:6601069bbe422156c75839c03e54b57c8f9cc4b8 Test::Instance::All http://gitlab-ee-e6c0e5a4.test -- qa/specs/features/ee/browser_ui/6_release/multi-project_pipelines_spec.rb...
    10875     creates a multi-project pipeline
    10876 Top 1 slowest examples (89.84 seconds, 100.0% of total time):
    10877   Release Multi-project pipelines creates a multi-project pipeline
    10878     89.84 seconds ./qa/specs/features/ee/browser_ui/6_release/multi-project_pipelines_spec.rb:76
    10879 Finished in 1 minute 29.85 seconds (files took 32.52 seconds to load)
    10880 1 example, 0 failures
  • Mark Lapierre approved this merge request

    approved this merge request

  • merged

  • Mark Lapierre mentioned in commit fd04f5ab

    mentioned in commit fd04f5ab

  • Mark Lapierre changed the description

    changed the description

  • Mark Lapierre changed the description

    changed the description

  • Mark Lapierre mentioned in merge request !369 (merged)

    mentioned in merge request !369 (merged)

  • Mark Lapierre mentioned in commit 1b7ef3d9

    mentioned in commit 1b7ef3d9

  • Please register or sign in to reply
    Loading