Skip to content
Snippets Groups Projects

qa:internal-as-if-foss

Passed Started by
Nailia Iskhakova
@niskhakova
1Running with gitlab-runner 15.9.0~beta.115.g598a7c91 (598a7c91)
2 on green-2.shared-gitlab-org.runners-manager.gitlab.com/default 8zCxmpPt, system ID: s_130a96ce9e65
3 feature flags: FF_NETWORK_PER_BUILD:true, FF_USE_FASTZIP:true, FF_USE_IMPROVED_URL_MASKING:true
4 Resolving secrets 00:00
5 Preparing the "docker+machine" executor 00:36
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0:bundler-2.3-chrome-109-docker-23.0.1 ...
7Authenticating with credentials from job payload (GitLab Registry)
8Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0:bundler-2.3-chrome-109-docker-23.0.1 ...
9Using docker image sha256:1ccd0038e4d4f003108d594df0832eb446109c015b18db14e7be4d80f4d59203 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0:bundler-2.3-chrome-109-docker-23.0.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0@sha256:8d7fbb81e2e925c0cf9e2c063cdf1dca72ff64c36bac611af8c0caef8b309aa4 ...
10 Preparing environment 00:06
11Running on runner-8zcxmppt-project-278964-concurrent-0 via runner-8zcxmppt-shared-gitlab-org-1680010389-e6b2682c...
12 Getting source from Git repository 00:25
13$ eval "$CI_PRE_CLONE_SCRIPT"
14Fetching changes with git depth set to 20...
15Initialized empty Git repository in /builds/gitlab-org/gitlab/.git/
16Created fresh repository.
17remote: Enumerating objects: 168536, done.
18remote: Counting objects: 100% (168536/168536), done.
19remote: Compressing objects: 100% (107987/107987), done.
20remote: Total 168536 (delta 80367), reused 116592 (delta 54049), pack-reused 0
21Receiving objects: 100% (168536/168536), 132.70 MiB | 31.43 MiB/s, done.
22Resolving deltas: 100% (80367/80367), done.
23From https://git-us-east1-d.ci-gateway.int.gprd.gitlab.net:8989/gitlab-org/gitlab
24 * [new ref] refs/pipelines/820503977 -> refs/pipelines/820503977
25Checking out da011c02 as detached HEAD (ref is refs/merge-requests/116002/merge)...
26Skipping Git submodules setup
27$ git remote set-url origin "${CI_REPOSITORY_URL}"
28 Restoring cache 00:04
29Checking cache for qa-ruby-gems-debian-bullseye-ruby-3.0-cb64bd903f4eb012a7ececfc89cb0998ad044785-16...
30Downloading cache.zip from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/qa-ruby-gems-debian-bullseye-ruby-3.0-cb64bd903f4eb012a7ececfc89cb0998ad044785-16
31Successfully extracted cache
32 Executing "step_script" stage of the job script 00:07
33Using docker image sha256:1ccd0038e4d4f003108d594df0832eb446109c015b18db14e7be4d80f4d59203 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0:bundler-2.3-chrome-109-docker-23.0.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0@sha256:8d7fbb81e2e925c0cf9e2c063cdf1dca72ff64c36bac611af8c0caef8b309aa4 ...
34$ echo $FOSS_ONLY
351
36$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
37$ export GOPATH=$CI_PROJECT_DIR/.go
38$ mkdir -p $GOPATH
39$ source scripts/utils.sh
40$ source scripts/prepare_build.sh
41Using decomposed database config (config/database.yml.decomposed-postgresql)
42Geo DB won't be set up.
43$ cd qa && bundle install
44Bundle complete! 36 Gemfile dependencies, 124 gems now installed.
45Gems in the groups 'production' and 'development' were not installed.
46Bundled gems are installed into `./vendor`
47$ bundle exec rspec -O .rspec_internal
48Randomized with seed 43794
49QA::Resource::Events::Base
50 #events
51 fetches all events when called without parameters
52 fetches events with a specified action type
53QA::Scenario::Actable
54 .act
55 supports passing variables
56 provides means to run steps
57 returns value from the last method
58 .perform
59 makes it possible to pass binding
60QA::Vendor::Smocker::SmockerApi
61 retries until the service is ready
62QA::Runtime::AllureReport
63 with report generation enabled
64 configures attachments saving
65 adds rspec and metadata formatter
66 configures Allure options
67 with report generation disabled
68 does not perform configuration
69QA::Specs::Helpers::FeatureFlag
70 .skip_or_run_feature_flag_tests_or_contexts
71 when run without a gitlab address specified
72 behaves like runs with given feature flag metadata
73 is expected to eq :passed
74 behaves like runs with given feature flag metadata
75 is expected to eq :passed
76 behaves like runs with given feature flag metadata
77 is expected to eq :passed
78 when run on jh production hk
79 when no scope is defined
80 behaves like skips with given feature flag metadata
81 is expected to eq :pending
82 for only one test in the example group
83 only skips specified test and runs all others
84 behaves like skips with given feature flag metadata
85 is expected to eq :pending
86 behaves like skips with given feature flag metadata
87 is expected to eq :pending
88 when run on staging
89 behaves like runs with given feature flag metadata
90 is expected to eq :passed
91 when should only run in a specific job
92 is run for that job
93 skips if test is set to only run in a job different from current CI job
94 when no scope is defined
95 is skipped if quarantine tag is also applied
96 behaves like runs with given feature flag metadata
97 is expected to eq :passed
98 behaves like skips with given feature flag metadata
99 is expected to eq :pending
100 when should be skipped in a specific job
101 is skipped for that job
102 when run on pre
103 for only one test in the example group
104 only skips specified test and runs all others
105 behaves like skips with given feature flag metadata
106 is expected to eq :pending
107 behaves like skips with given feature flag metadata
108 is expected to eq :pending
109 when run on jh production mainland
110 when no scope is defined
111 behaves like skips with given feature flag metadata
112 is expected to eq :pending
113 for only one test in the example group
114 only skips specified test and runs all others
115 behaves like skips with given feature flag metadata
116 is expected to eq :pending
117 behaves like skips with given feature flag metadata
118 is expected to eq :pending
119 when run on production
120 when no scope is defined
121 for only one test in the example group
122 only skips specified test and runs all others
123 behaves like skips with given feature flag metadata
124 is expected to eq :pending
125 behaves like skips with given feature flag metadata
126 is expected to eq :pending
127 behaves like skips with given feature flag metadata
128 is expected to eq :pending
129QA::Tools::LongRunningSpecReporter
130 with specs exceeding runtime
131 notifies on long running specs
132 without specs exceeding runtime
133 returns all good message
134QA::Page::Validator
135 #constants
136 returns all constants that are module children
137 #descendants
138 recursively returns all descendants that are page objects
139 does not return modules that aggregate page objects
140 when checking validation errors
141 when there are no validation errors
142 #errors
143 does not return errors
144 #validate!
145 does not raise error
146 when there are validation errors
147 #errors
148 returns errors
149 #validate!
150 raises validation error
151QA::Service::Shellout
152 when masking secrets
153[Mar 28 2023 14:58:03 UTC (QA Tests)] INFO -- Executing: `docker login -u **** -p ****`
154[Mar 28 2023 14:58:03 UTC (QA Tests)] ERROR -- Command output:
155logged in as **** with password ****
156 masks command secrets on CommandError
157[Mar 28 2023 14:58:03 UTC (QA Tests)] INFO -- Executing: `docker login -u **** -p ****`
158 masks secrets when yielding output
159 masks secrets when logging the command itself
160[Mar 28 2023 14:58:03 UTC (QA Tests)] INFO -- Executing: `docker login -u **** -p ****`
161 masks secrets in debug logs
162[Mar 28 2023 14:58:03 UTC (QA Tests)] INFO -- Executing: `docker pull ruby:3`
163[Mar 28 2023 14:58:03 UTC (QA Tests)] ERROR -- Command output:
164logged in as user with password secret
165 masking secrets is optional
166[Mar 28 2023 14:58:03 UTC (QA Tests)] INFO -- Executing: `docker login -u **** -p ****`
167 masks secrets in error logs
168QA::Runtime::Env
169 .running_in_ci?
170 when there is an env variable set
171 returns true if CI
172 returns true if CI_SERVER
173 when there is no env variable set
174 returns true
175 .canary_cookie
176 without QA_COOKIES set
177 is expected to be empty
178 with QA_COOKIES set
179 cookie_value: "gitlab_canary=false", result: {:gitlab_canary=>"false"}
180 is expected to eq {:gitlab_canary=>"false"}
181 cookie_value: "gitlab_canary=true", result: {:gitlab_canary=>"true"}
182 is expected to eq {:gitlab_canary=>"true"}
183 cookie_value: "gitlab_canary=false\\;other_cookie=value", result: {:gitlab_canary=>"false"}
184 is expected to eq {:gitlab_canary=>"false"}
185 cookie_value: "other_cookie=value\\;gitlab_canary=true", result: {:gitlab_canary=>"true"}
186 is expected to eq {:gitlab_canary=>"true"}
187 .personal_access_token
188 when @personal_access_token is set
189 returns the instance variable value
190 when GITLAB_QA_ACCESS_TOKEN is set
191 returns specified token from env
192 .require_github_access_token!
193 raises ArgumentError if QA_GITHUB_ACCESS_TOKEN is not defined
194 does not raise if QA_GITHUB_ACCESS_TOKEN is defined
195 .running_on_dev?
196 url: "http://gdk.test:3000", result: true
197 is expected to eq true
198 url: "https://www.gitlab.com", result: false
199 is expected to eq false
200 url: "http://localhost:3000", result: true
201 is expected to eq true
202 url: "http://localhost", result: false
203 is expected to eq false
204 .personal_access_token=
205 saves the token
206 .require_admin_access_token!
207 does not raise exception if GITLAB_QA_ADMIN_ACCESS_TOKEN is specified
208 raises ArgumentError if GITLAB_QA_ADMIN_ACCESS_TOKEN is not specified
209 .github_access_token
210 returns "" if QA_GITHUB_ACCESS_TOKEN is not defined
211 returns stripped string if QA_GITHUB_ACCESS_TOKEN is defined
212 .forker?
213 returns false if only forker username is defined
214 returns true if forker username and password are defined
215 returns false if only forker password is defined
216 returns false if no forker credentials are defined
217 .webdriver_headless?
218 behaves like boolean method
219 behaves like boolean method with parameter
220 when there is no env variable set
221 returns the default, true
222 when there is an env variable set
223 returns true when anything else specified
224 returns false when falsey values specified
225 .knapsack?
226 returns true if running in parallel CI run
227 returns false if knapsack disabled
228 returns false if not running in a parallel job
229 returns false if not running in ci
230 .remote_grid_protocol
231 defaults protocol to http
232 .can_test?
233 raises ArgumentError if feature is unknown
234 behaves like boolean method with parameter
235 when there is an env variable set
236 returns false when falsey values specified
237 returns true when anything else specified
238 when there is no env variable set
239 returns the default, true
240 behaves like boolean method with parameter
241 when there is no env variable set
242 returns the default, true
243 when there is an env variable set
244 returns true when anything else specified
245 returns false when falsey values specified
246 behaves like boolean method with parameter
247 when there is no env variable set
248 returns the default, true
249 when there is an env variable set
250 returns true when anything else specified
251 returns false when falsey values specified
252 remote grid credentials
253 is blank if username is empty
254 returns a user:key@ combination when all args are satiated
255 throws ArgumentError if GRID_ACCESS_KEY is not specified with USERNAME
256 .signup_disabled?
257 behaves like boolean method
258 behaves like boolean method with parameter
259 when there is an env variable set
260 returns true when anything else specified
261 returns false when falsey values specified
262 when there is no env variable set
263 returns the default, false
264 .remote_grid
265 accepts https protocol
266 is falsey if QA_REMOTE_GRID is not set
267 without credentials
268 has a grid of http://grid/wd/hub
269 with credentials
270 has a grid of http://user:key@grid/wd/hub
271 .running_on_dot_com?
272 url: "https://www.gitlab.com", result: true
273 is expected to eq true
274 url: "http://www.gitlab.com", result: true
275 is expected to eq true
276 url: "http://gdk.test:3000", result: false
277 is expected to eq false
278 url: "https://staging.gitlab.com", result: true
279 is expected to eq true
280 url: "http://localhost:3000", result: false
281 is expected to eq false
282 url: "http://localhost", result: false
283 is expected to eq false
284QA::Runtime::Key::RSA
285 #public_key
286[Mar 28 2023 14:58:03 UTC (QA Tests)] INFO -- Executing: `ssh-keygen -t rsa -b 4096 -f /tmp/d20230328-30-hu8lk0/id_rsa -N `
287 generates a public RSA key
288QA::Tools::ReliableReport
289 without report creation
290 does not create report issue
291 with report creation
292 creates report issue
293 with failure
294 notifies failure
295QA::Specs::ParallelRunner
296 passes tags and test paths with separators to parallel_tests
297 passes supported environment variables
298 passes a given test path to parallel_tests and adds a separator
299 passes tags and test paths to parallel_tests and adds a separator
300 passes args to parallel_tests
301QA::Resource::Base
302 .fabricate_via_browser_ui!
303 when fabricating
304[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource #[Double "resource"] via cache in 0.0 seconds
305 instantiates the resource and calls resource method
306[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource #[Double "resource"] via cache in 0.0 seconds
307 returns fabrication resource
308 behaves like fabrication method
309[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource #[Double "resource"] via cache in 0.0 seconds
310 yields resource before calling resource method
311 with debug log level
312 logs the resource and build method
313 .attribute
314 when multiple resources have the same attribute name
315[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a via browser_ui in 0.0 seconds
316[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a via browser_ui in 0.0 seconds
317 has unique attribute values
318 when the attribute is populated via the api
319[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource with username 'qa' via browser_ui in 0.0 seconds
320 returns value from api
321 when the attribute is token and has a block
322[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource with username 'qa' via browser_ui in 0.0 seconds
323 emits a masked debug log entry
324 when the attribute also has a block
325[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource with username 'qa' via browser_ui in 0.0 seconds
326 returns value from api and emits an debug log entry
327 when the attribute has no value
328[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource with username 'qa' via browser_ui in 0.0 seconds
329 raises an error because no values could be found
330 when the attribute is populated via direct assignment
331[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource with username 'qa' via browser_ui in 0.0 seconds
332 returns value from the assignment
333 when the api also has such response
334[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource with username 'qa' via browser_ui in 0.0 seconds
335 returns value from the assignment
336 when the attribute is populated via a block
337[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource with username 'qa' via browser_ui in 0.0 seconds
338 returns value from the block
339 .fabricate!
340 when personal_access_tokens_disabled returns true
341 calls .fabricate_via_browser_ui!
342 when resource supports fabrication via the API
343 calls .fabricate_via_api!!
344 when resource does not support fabrication via the API
345 calls .fabricate_via_browser_ui!
346 .fabricate_via_api!
347 with debug log level
348[Mar 28 2023 14:58:04 UTC (QA Tests)] WARN -- Resource fabrication http method has not been set properly, assuming :get value!
349 logs the resource and build method
350 when fabricating
351[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Retrieved a MyResource #[Double "resource"] via cache in 0.0 seconds
352 instantiates the resource, calls resource method returns the resource
353 behaves like fabrication method
354[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Retrieved a MyResource #[Double "resource"] via cache in 0.0 seconds
355 yields resource before calling resource method
356 .fabricate_via_api_unless_fips!
357 when personal_access_tokens_disabled returns true
358 calls .fabricate_via_browser_ui!
359 when personal_access_tokens_disabled returns false
360 calls .fabricate_via_api!!
361 #visit!
362[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- Visiting MyResource at http://stub
363 calls #visit with the underlying #web_url
364[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- Visiting MyResource at http://stub
365 calls #visit with the underlying #web_url with skip_resp_code_check specified as true
366 #web_url
367[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- ==> Built a MyResource with username 'qa' via browser_ui in 0.0 seconds
368 sets #web_url to #current_url after fabrication
369QA::Scenario::Bootable
370 makes it possible to define the scenario attribute
371 does not require attributes to be defined
372QA::Service::DockerRun::Base
373 when authenticating
374 caches the the registry
375 forces authentication if the registry is cached
376QA::Scenario::Test::Instance::Smoke
377 behaves like a QA scenario class
378 responds to perform
379 sets tags on runner
380 performs before hooks only once
381 with RSpec options
382 sets options on runner
383 with named command-line options
384 raises an error if the option is invalid
385 passes on options after --
386 converts options to attributes
387QA::Runtime::Logger
388 returns logger instance
389QA::Service::DockerRun::K3s
390 #host_name
391 not in CI
392 returns localhost if not running in a CI environment
393 in CI
394 returns name.network
395QA::Support::Formatters::TestMetricsFormatter
396 without influxdb variables configured
397[Mar 28 2023 14:58:04 UTC (QA Tests)] WARN -- [influxdb exporter]: Missing run_type, skipping metrics export!
398 skips export without influxdb url
399[Mar 28 2023 14:58:04 UTC (QA Tests)] WARN -- [influxdb exporter]: Missing run_type, skipping metrics export!
400 skips export without influxdb token
401 with influxdb variables configured
402 with fabrication runtimes
403 exports data to influxdb with fabrication times
404 with smoke spec
405 exports data to influxdb with correct smoke tag
406 with product group tag
407 exports data to influxdb with correct reliable tag
408 with quarantined spec
409 exports data to influxdb with correct quarantine tag
410 with reliable spec
411 exports data to influxdb with correct reliable tag
412 with additional custom metrics
413 exports data to influxdb with additional metrics
414 with skipped spec
415 skips export
416 with staging full run
417 exports data to influxdb with correct run type
418 with staging sanity no admin
419 exports data to influxdb with correct run type
420 with context quarantined spec
421 exports data to influxdb with correct qurantine tag
422 with fabrication resources
423 exports fabrication stats data to influxdb
424 with persisting metrics
425 saves test metrics as json files
426QA::Support::WaitForRequests
427 .wait_for_requests
428 when skip_finished_loading_check is defaulted to false
429 calls finished_loading?
430 when skip_resp_code_check is true
431 does not parse for an error code
432QA::Scenario::Test::Integration::ServicePingDisabled
433 #perform
434 behaves like a QA scenario class
435 performs before hooks only once
436 sets tags on runner
437 responds to perform
438 with RSpec options
439 sets options on runner
440 with named command-line options
441 raises an error if the option is invalid
442 converts options to attributes
443 passes on options after --
444QA::Resource::User
445 #fabricate_via_api!
446 tries to create a user if it does not exist
447 fetches an existing user
448QA::Support::Page::Logging
449 logs find_element with text
450 logs click_element with a page
451 logs has_text?
452 logs has_element?
453 logs scroll_to
454 logs find_element with class
455 logs click_element
456 logs fill_element
457 logs has_no_element? with text
458 logs find_element with wait
459 logs finished_loading?
460 logs within_element
461 logs find_element
462 logs has_no_text?
463 logs refresh
464 logs asset_exists?
465 logs has_no_element?
466 logs has_element? with text
467 with all_elements
468 logs 0 if no elements are found
469 logs the number of elements found
470QA::Resource::Events::Project
471 #wait_for_push
472 raises an error if a push with the specified commit message is not found
473 waits for a push with a specified commit message
474 #wait_for_push_new_branch
475 waits for a push to the default branch if no branch is given
476 waits for a push to the given branch
477 raises an error if a push with the specified branch is not found
478QA::Resource::SSHKey
479 #title
480 generates a default title
481 is possible to set the title
482 #key
483[Mar 28 2023 14:58:04 UTC (QA Tests)] INFO -- Executing: `ssh-keygen -t rsa -b 4096 -f /tmp/d20230328-30-dkwieo/id_rsa -N `
484 generates a default key
485QA::Support::Loglinking
486 .failure_metadata
487 when correlation_id exists
488 and only Kibana exists for the logging environment
489 returns only Kibana Discover and Dashboard URLs
490 and both Sentry and Kibana exist for the logging environment
491 returns both Sentry and Kibana URLs
492 and only Sentry exists for the logging environment
493 returns only Sentry URL
494 and neither Sentry nor Kibana exists for the logging environment
495 returns only the correlation ID
496 when correlation_id does not exist
497 returns nil when correlation_id is empty
498 returns nil when correlation_id is nil
499 .logging_environment
500 returns logging environment if environment found
501QA::Support::Repeater
502 .repeat_until
503 with logging
504 allows logging to be silenced
505 skips logging single attempt with max_duration
506 starts logging on subsequent attempts for max_duration
507 skips logging single attempt with max_attempts
508 starts logging subsequent attempts for max_attempts
509 when raise_on_failure is not provided (default: true)
510 when retry_on_exception is not provided (default: false)
511 when both max_attempts and max_duration are provided
512 when max_duration is reached first
513 raises an exception
514 when max_attempts is reached first
515 raises an exception
516 when max_duration is provided
517 when max duration is reached
518 raises an exception with custom message
519 ignores attempts
520 raises an exception with default message
521 when max duration is not reached
522 returns value from block
523 when max_attempts is provided
524 when max_attempts is not reached
525 returns value from block
526 when max_attempts is reached
527 raises an exception with default message
528 ignores duration
529 raises an exception with custom message
530 when retry_on_exception is true
531 when max duration is reached
532 does not raise an exception until max_duration is reached
533 raises an exception
534 when max duration is not reached
535 returns value from block
536 when raise_on_failure is false
537 when retry_on_exception is true
538 when max duration is reached
539 does not raise an exception
540 returns the value from the block
541 when retry_on_exception is not provided (default: false)
542 when both max_attempts and max_duration are provided
543 when max_attempts is reached first
544 behaves like repeat until
545 returns when max_attempts is reached
546 when max_duration is reached first
547 behaves like repeat until
548 returns when max_duration is reached
549 when max duration is not reached
550 raises an exception
551 returns the value from the block
552 when max duration is reached
553 returns the value from the block
554 does not raise an exception
555QA::Tools::Ci::QaChanges
556 with non qa changes
557 .framework_changes? return false
558 .quarantine_changes? return false
559 without mr labels
560 .qa_tests do not return any specific specs
561 with mr label
562 .qa_tests return specs for devops stage
563 when configured to run tests from other stages
564 with a multiple extra stages configured for the group name
565 .qa_tests return specs for both devops stage and multiple other stages
566 with a single extra stage configured for the group name
567 .qa_tests return specs for both devops stage and create stage
568 with shared example changes
569 .qa_tests do not return specific specs
570 when Dockerfile.assets change
571 .qa_tests do not return specific specs
572 when GITALY_SERVER_VERSION change
573 .qa_tests do not return specific specs
574 with spec only changes
575 .framework_changes? return false
576 .qa_tests return changed specs
577 .quarantine_changes? return false
578 with quarantine changes
579 .quarantine_changes? return true
580 when Gemfile.lock change
581 .qa_tests do not return specific specs
582 with framework changes
583 .qa_tests do not return specific specs
584 .framework_changes? return true
585 .quarantine_changes? return false
586 when yarn.lock change
587 .qa_tests do not return specific specs
588QA::Scenario::Test::Instance::Airgapped
589 #perform
590 behaves like a QA scenario class
591 responds to perform
592 sets tags on runner
593 performs before hooks only once
594 with named command-line options
595 passes on options after --
596 converts options to attributes
597 raises an error if the option is invalid
598 with RSpec options
599 sets options on runner
600QA::Runtime::Feature
601 feature_flag: :a_flag
602 .enable
603[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Enabling feature: a_flag
604[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Successfully enabled and verified feature flag: a_flag
605 enables a feature flag
606 when a project scope is provided
607 behaves like enables a feature flag
608 enables a feature flag for a scope
609 when a feature group scope is provided
610 behaves like enables a feature flag
611 enables a feature flag for a scope
612 when a user scope is provided
613 behaves like enables a feature flag
614 enables a feature flag for a scope
615 when a group scope is provided
616 behaves like enables a feature flag
617 enables a feature flag for a scope
618 .enabled?
619 returns a feature flag state
620 raises an error when the scope is unknown
621 when a group scope is provided
622 behaves like checks a feature flag
623 when the flag is enabled for a scope
624 returns the feature flag state
625 when a user scope is provided
626 behaves like checks a feature flag
627 when the flag is enabled for a scope
628 returns the feature flag state
629 with definition files
630 when the feature is found via the API
631 returns the value from the API not the definition file
632 when no features are found via the API
633 with a default enabled defintion
634 returns a default enabled flag
635 with a default disabled defintion
636 returns a default disabled flag
637 when a feature flag is not found via the API and there is no definition file
638 raises an error
639 when a project scope is provided
640 behaves like checks a feature flag
641 when the flag is enabled for a scope
642 returns the feature flag state
643 when a feature group scope is provided
644 behaves like checks a feature flag
645 when the flag is enabled for a scope
646 returns the feature flag state
647 .disable
648[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Disabling feature: a_flag
649[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Successfully disabled and verified feature flag: a_flag
650 disables a feature flag
651 when a group scope is provided
652 behaves like disables a feature flag
653 disables a feature flag for a scope
654 when a project scope is provided
655 behaves like disables a feature flag
656 disables a feature flag for a scope
657 when a feature group scope is provided
658 behaves like disables a feature flag
659 disables a feature flag for a scope
660 when a user scope is provided
661 behaves like disables a feature flag
662 disables a feature flag for a scope
663 feature_flag: "a_flag"
664 .disable
665[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Disabling feature: a_flag
666[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Successfully disabled and verified feature flag: a_flag
667 disables a feature flag
668 when a project scope is provided
669 behaves like disables a feature flag
670 disables a feature flag for a scope
671 when a group scope is provided
672 behaves like disables a feature flag
673 disables a feature flag for a scope
674 when a feature group scope is provided
675 behaves like disables a feature flag
676 disables a feature flag for a scope
677 when a user scope is provided
678 behaves like disables a feature flag
679 disables a feature flag for a scope
680 .enable
681[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Enabling feature: a_flag
682[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Successfully enabled and verified feature flag: a_flag
683 enables a feature flag
684 when a project scope is provided
685 behaves like enables a feature flag
686 enables a feature flag for a scope
687 when a group scope is provided
688 behaves like enables a feature flag
689 enables a feature flag for a scope
690 when a feature group scope is provided
691 behaves like enables a feature flag
692 enables a feature flag for a scope
693 when a user scope is provided
694 behaves like enables a feature flag
695 enables a feature flag for a scope
696 .enabled?
697 returns a feature flag state
698 raises an error when the scope is unknown
699 with definition files
700 when no features are found via the API
701 with a default enabled defintion
702 returns a default enabled flag
703 with a default disabled defintion
704 returns a default disabled flag
705 when the feature is found via the API
706 returns the value from the API not the definition file
707 when a group scope is provided
708 behaves like checks a feature flag
709 when the flag is enabled for a scope
710 returns the feature flag state
711 when a user scope is provided
712 behaves like checks a feature flag
713 when the flag is enabled for a scope
714 returns the feature flag state
715 when a project scope is provided
716 behaves like checks a feature flag
717 when the flag is enabled for a scope
718 returns the feature flag state
719 when a feature group scope is provided
720 behaves like checks a feature flag
721 when the flag is enabled for a scope
722 returns the feature flag state
723 when a feature flag is not found via the API and there is no definition file
724 raises an error
725 .set
726 disables feature flags
727 enables and disables feature flags
728 enables feature flags
729 raises an error when the flag state is unknown
730QA::Service::DockerRun::GitlabRunner
731 defaults to run untagged
732 #register!
733 executors
734 defaults to the shell executor
735 docker
736 passes privileged mode
737 has a default image
738 mounts the docker socket to the host runner
739 runs in privileged mode
740 specifies the docker executor
741 does not verify TLS
742 passes the host network
743 defaults
744 has no tags
745 runs daemonized
746 cleans itself up
747 runs untagged
748 masks the registration token
749 sets pertinent information
750 runs non-interactively
751 running untagged
752 passes --run-untagged=true
753 does not pass tag list
754 running tagged
755 when specifying contradicting variables
756 raises an error
757 with only tags set
758 does not pass --run-untagged
759 passes the tags with comma-separation
760 with specifying only run_untagged
761 raises an error if tags are not specified
762 #tags=
763 sets the tags
764 sets run_untagged
765QA::Specs::Helpers::Quarantine
766 .skip_or_run_quarantined_tests_or_contexts
767 with :quarantine and non-quarantine tags focused
768 ignores non-quarantined non-focused tests
769 executes quarantined focused tests
770 skips quarantined non-focused tests
771 skips non-quarantined focused tests
772 with explicitly disabled quarantine
773 runs quarantined test
774 with :quarantine focused
775 executes quarantined tests
776 ignores non-quarantined tests
777 with a non-quarantine tag focused
778 executes non-quarantined focused tests
779 ignores non-quarantined non-focused tests
780 skips quarantined focused tests
781 ignores quarantined tests
782 with no tag focused
783 skips quarantined tests
784 executes non-quarantined tests
785 with environment set
786 no pipeline specified
787 is skipped only in staging
788 is skipped when set on contexts or descriptions
789 multiple pipelines specified
790 behaves like skipped in project
791 is skipped in STAGING
792 behaves like skipped in project
793 is skipped in PRODUCTION
794 behaves like skipped in project
795 is skipped in CANARY
796 quarantine message
797 behaves like test with quarantine message
798 outputs the quarantine message
799 behaves like test with quarantine message
800 outputs the quarantine message
801 .skip_or_run_quarantined_contexts
802 with no tag focused
803 skips before hooks of quarantined contexts
804 executes before hooks of non-quarantined contexts
805 with :quarantine focused
806 skips before hooks of non-quarantined contexts
807 executes before hooks of quarantined contexts
808QA::Service::DockerRun::Mixins::ThirdPartyDocker
809 with environment set
810 sends a command to authenticate against the registry
811 resolves the registry from the environment
812 without environment set
813 throws if environment is missing
814 resolving the registry returns nil
815QA::Tools::TestResourceDataProcessor
816 .collect
817 collects and stores resource
818 .write_to_file
819 ci: true, suite_failed: false, file_path: "root/tmp/test-resources-random.json"
820 writes applicable resources to file
821 ci: true, suite_failed: true, file_path: "root/tmp/failed-test-resources-random.json"
822 writes applicable resources to file
823 ci: false, suite_failed: false, file_path: "root/tmp/test-resources.json"
824 writes applicable resources to file
825 ci: false, suite_failed: true, file_path: "root/tmp/failed-test-resources.json"
826 writes applicable resources to file
827QA::Scenario::Test::Integration::InstanceSAML
828 #perform
829 behaves like a QA scenario class
830 performs before hooks only once
831 sets tags on runner
832 responds to perform
833 with RSpec options
834 sets options on runner
835 with named command-line options
836 raises an error if the option is invalid
837 passes on options after --
838 converts options to attributes
839QA::Scenario::Test::Sanity::Selectors
840 when there are no errors detected
841 triggers validation
842 processes pages module
843 when there are errors detected
844 outputs information about errors
845QA::Resource::ProjectWebHook
846 adds an #event method to the smocker object that returns webhook events
847 configures the project hook events
848QA::Specs::Runner
849 #perform
850 when tags are set
851 focuses on the given tags
852 behaves like excludes default skipped, and geo
853 excludes the default skipped and geo tags, and includes default args
854 when test_metadata_only is set as an option
855Saved to file: /root/tmp/test-metadata.json
856 configures json formatted output to file
857Saved to file: /builds/gitlab-org/gitlab/qa/tmp/test-metadata.json
858 sets the `--dry-run` flag
859 testable features
860 when no features are supported
861 behaves like one supported feature
862 includes default args and excludes all unsupported tags
863 when features are not specified
864 behaves like excludes default skipped, and geo
865 excludes the default skipped and geo tags, and includes default args
866 when only admin features are supported
867 behaves like one supported feature
868 includes default args and excludes all unsupported tags
869 when all features are supported
870 behaves like excludes default skipped, and geo
871 excludes the default skipped and geo tags, and includes default args
872 when only git protocol 2 is supported
873 behaves like one supported feature
874 includes default args and excludes all unsupported tags
875 when "--tag smoke" and "qa/specs/features/foo" are set as options
876 focuses on the given tag and includes the path without excluding the orchestrated or transient tags
877 when "qa/specs/features/foo" is set as options
878 passes the given tests path and excludes the default skipped, and geo tags
879 when SIGNUP_DISABLED is true
880 includes default args and excludes the skip_signup_disabled tag
881 when "--tag smoke" is set as options
882 focuses on the given tag without excluded tags
883 when count_examples_only is set as an option
884 raises error when Rspec output does not match regex
88522
886 writes to file when examples are more than zero
8870
888 does not write to file when zero examples
88922
890 sets the `--dry-run` flag
891 when --tag is specified as an option
89222
893 includes the option value in the file name
894 when running against a Geo environment
895 includes the geo tag
896 when running against live environment
897 includes default args and excludes the skip_live_env tag
898 when tty is set
899 sets the `--tty` flag
900QA::Page::View
901 #pathname
902 returns an absolute and clean path to the view
903 .evaluate
904 evaluates a block and returns a DSL object
905 #errors
906 when view partial has not been found
907 returns an error when it is not able to find the partial
908 when view partial is present
909 when pattern is found
910 walks through the view and asserts on elements existence
911 when pattern has not been found
912 returns an array of errors related to missing elements
913QA::Support::Run
914 runs successfully
915 raises an exception on 3rd failure
916 retries twice and succeeds the third time
917QA::Tools::Ci::TestMetrics
918 without metrics files present
919 exits without error
920 with metrics files present
921 exports saved metrics to influxdb
922QA::Support::Retrier
923 .retry_until
924 sets sleep_interval to 0 by default
925 sets custom error message
926 sets raise_on_failure to true by default
927 sets retry_on_exception to false by default
928 allows logs to be silenced
929 when max_duration and max_attempts are nil
930 sets max attempts to 3 by default
931 .retry_on_exception
932 allows logs to be silenced
933 does not repeat if no exception is raised
934 sets retry_on_exception to true
935 sets max_attempts to 3 by default
936 sets sleep_interval to 0.5 by default
937QA::Tools::Ci::NonEmptySuites
938 returns runnable test suites
939QA::Tools::Ci::FfChanges
940 without merge request pipeline
941 with empty mr diff
942 doesn't return any ff options
943 with merge request pipeline
944 with changed feature flag
945 returns inverse ff state option
946 with deleted feature flag
947 returns deleted ff state option
948QA::Support::PageErrorChecker
949 .report!
950 reports errors
951 reports error message on chrome browser
952 reports basic message on non-chrome browser
953 does not report failure metadata on non 500 error
954 .parse_five_c_page_request_id
955 parse correlation ID
956 returns code is present
957 returns nil if not present
958 ::log_request_errors
959 logs graphql errors if any exist
960 chops the url query string
961 removes duplicates
962 returns if cache is nil
963 logs from the error cache
964 .error_report_for
965 returns error report array of log messages
966 .logs
967 gets driver browser logs
968 .check_page_for_error_code
969 calls report with 500 if 500 found
970 calls report with 404 if 404 found
971 calls report with 500 if GDK backtrace found
972 does not call report if 500 found in project name
973 does not call report if no 404, 500 or backtrace found
974 .status_code_report
975 returns a string message containing the status code
976 .return_chrome_errors
977 returns error message
978 returns report on multiple severe errors found
979 returns report on 1 severe error found
980 returns status code report on no severe errors found
981QA::Runtime::ApplicationSettings
982 .set_application_settings
983[Mar 28 2023 14:58:05 UTC (QA Tests)] INFO -- Setting application settings: {:allow_local_requests_from_web_hooks_and_services=>true}
984 sets application settings
985 .get_application_settings
986 gets application settings
987QA::Git::Repository
988 with default credentials
989 #fetch_supported_git_protocol
990 reports the detected version
991 reports unknown if version is unknown
992 reports unknown if content does not identify a version
993 behaves like command with retries
994 when command is not successful the first time
995 and retried command is not successful after 3 attempts
996 raises a CommandError exception
997 and retried command is successful
998 retries the command twice and returns the successful #run command Result output
999 when command is successful
1000 returns the #run command Result output
1001 #use_default_credentials
1002 adds credentials to .netrc
1003 #shallow_clone
1004 behaves like command with retries
1005 when command is successful
1006 returns the #run command Result output
1007 when command is not successful the first time
1008 and retried command is not successful after 3 attempts
1009 raises a CommandError exception
1010 and retried command is successful
1011 retries the command twice and returns the successful #run command Result output
1012 #clone
1013 when opts is given
1014 behaves like command with retries
1015 when command is successful
1016 returns the #run command Result output
1017 when command is not successful the first time
1018 and retried command is successful
1019 retries the command twice and returns the successful #run command Result output
1020 and retried command is not successful after 3 attempts
1021 raises a CommandError exception
1022 when no opts is given
1023 behaves like command with retries
1024 when command is successful
1025 returns the #run command Result output
1026 when command is not successful the first time
1027 and retried command is not successful after 3 attempts
1028 raises a CommandError exception
1029 and retried command is successful
1030 retries the command twice and returns the successful #run command Result output
1031 #git_protocol=
1032 configures git to use protocol version 2
1033 configures git to use protocol version 1
1034 configures git to use protocol version 0
1035 raises an error if the version is unsupported
1036 #push_changes
1037 when branch is given
1038 behaves like command with retries
1039 when command is successful
1040 returns the #run command Result output
1041 when command is not successful the first time
1042 and retried command is not successful after 3 attempts
1043 raises a CommandError exception
1044 and retried command is successful
1045 retries the command twice and returns the successful #run command Result output
1046 when no branch is given
1047 behaves like command with retries
1048 when command is not successful the first time
1049 and retried command is successful
1050 retries the command twice and returns the successful #run command Result output
1051 and retried command is not successful after 3 attempts
1052 raises a CommandError exception
1053 when command is successful
1054 returns the #run command Result output
1055 with push options
1056 when a label is given
1057 behaves like command with retries
1058 when command is successful
1059 returns the #run command Result output
1060 when command is not successful the first time
1061 and retried command is successful
1062 retries the command twice and returns the successful #run command Result output
1063 and retried command is not successful after 3 attempts
1064 raises a CommandError exception
1065 when target branch is given
1066 behaves like command with retries
1067 when command is not successful the first time
1068 and retried command is successful
1069 retries the command twice and returns the successful #run command Result output
1070 and retried command is not successful after 3 attempts
1071 raises a CommandError exception
1072 when command is successful
1073 returns the #run command Result output
1074 when two labels are given
1075 behaves like command with retries
1076 when command is successful
1077 returns the #run command Result output
1078 when command is not successful the first time
1079 and retried command is successful
1080 retries the command twice and returns the successful #run command Result output
1081 and retried command is not successful after 3 attempts
1082 raises a CommandError exception
1083 when set to remove source branch
1084 behaves like command with retries
1085 when command is not successful the first time
1086 and retried command is successful
1087 retries the command twice and returns the successful #run command Result output
1088 and retried command is not successful after 3 attempts
1089 raises a CommandError exception
1090 when command is successful
1091 returns the #run command Result output
1092 when set to create a merge request
1093 behaves like command with retries
1094 when command is successful
1095 returns the #run command Result output
1096 when command is not successful the first time
1097 and retried command is not successful after 3 attempts
1098 raises a CommandError exception
1099 and retried command is successful
1100 retries the command twice and returns the successful #run command Result output
1101 when description is given
1102 behaves like command with retries
1103 when command is not successful the first time
1104 and retried command is successful
1105 retries the command twice and returns the successful #run command Result output
1106 and retried command is not successful after 3 attempts
1107 raises a CommandError exception
1108 when command is successful
1109 returns the #run command Result output
1110 when set to merge when pipeline succeeds
1111 behaves like command with retries
1112 when command is not successful the first time
1113 and retried command is successful
1114 retries the command twice and returns the successful #run command Result output
1115 and retried command is not successful after 3 attempts
1116 raises a CommandError exception
1117 when command is successful
1118 returns the #run command Result output
1119 when title is given
1120 behaves like command with retries
1121 when command is not successful the first time
1122 and retried command is not successful after 3 attempts
1123 raises a CommandError exception
1124 and retried command is successful
1125 retries the command twice and returns the successful #run command Result output
1126 when command is successful
1127 returns the #run command Result output
1128 #delete_tag
1129 behaves like command with retries
1130 when command is successful
1131 returns the #run command Result output
1132 when command is not successful the first time
1133 and retried command is not successful after 3 attempts
1134 raises a CommandError exception
1135 and retried command is successful
1136 retries the command twice and returns the successful #run command Result output
1137 with specific credentials
1138 #password=
1139 raises an error if no username was given
1140 adds credentials to .netrc
1141 adds credentials with special characters
1142 before setting credentials
1143 does not add credentials to .netrc
1144QA::Page::Element
1145 #selector
1146 transforms element name into QA-specific selector
1147 when pattern is an expression
1148 matches when there is a match
1149 does not match if pattern is not present
1150 when pattern is not provided
1151 matches when QA specific selector is present
1152 does not match if QA selector is not there
1153 matches when element name is specified
1154 when pattern is a string
1155 does not match if pattern is not present
1156 matches when there is match
1157 #selector_css
1158 transforms element name into QA-specific clickable css selector
1159 attributes
1160 element with no args
1161 defaults pattern to #selector
1162 is not required by default
1163 element with a pattern
1164 has an attribute[pattern] of the pattern
1165 is not required by default
1166 element with requirement and pattern
1167 has a selector of the name
1168 is required
1169 has an attribute[pattern] of the passed pattern
1170 element with requirement; no pattern
1171 is required
1172 has an attribute[pattern] of the selector
1173 data-qa selectors
1174 properly translates to a data-qa-selector
1175 additional selectors
1176 doesnt conflict with element requirement
1177 translates snake_case to kebab-case
1178 matches on additional data-qa properties
1179QA::Resource::ApiFabricator
1180 #fabricate_via_api!
1181 when resource supports fabrication via the API
1182 when creating a resource
1183 returns the resource URL
1184 populates api_resource with the resource
1185 when the POST fails
1186 raises a ResourceFabricationFailedError exception
1187 logs Sentry and Kibana URLs from staging
1188 logs a correlation id
1189 #transform_api_resource
1190 transforms the resource
1191 when resource does not support fabrication via the API
1192 raises a NotImplementedError exception
1193 #api_support?
1194 when resource supports fabrication via the API
1195 returns false
1196 when resource does not support fabrication via the API
1197 returns false
1198QA::Support::SystemLogs::Kibana
1199 #discover_url
1200 behaves like returns the expected URL
1201 env: :staging, expected_url: staging_url
1202 is expected to eq "https://nonprod-log.gitlab.net/app/discover#/?_a=%28index:%27ed942d00-5186-11ea-ad8a-f3610a492295%27...9&_g=%28time%3A%28from%3A%272022-11-13T00:00:00.000Z%27%2Cto%3A%272022-11-14T00:00:00.000Z%27%29%29"
1203 env: nil, expected_url: nil
1204 is expected to eq nil
1205 env: :foo, expected_url: nil
1206 is expected to eq nil
1207 env: :production, expected_url: production_url
1208 is expected to eq "https://log.gprd.gitlab.net/app/discover#/?_a=%28index:%277092c4e2-4eb5-46f2-8305-a7da2edad090%27%2C...9&_g=%28time%3A%28from%3A%272022-11-13T00:00:00.000Z%27%2Cto%3A%272022-11-14T00:00:00.000Z%27%29%29"
1209 env: :pre, expected_url: pre_url
1210 is expected to eq "https://nonprod-log.gitlab.net/app/discover#/?_a=%28index:%27pubsub-rails-inf-pre%27%2Cquery%3A%28la...9&_g=%28time%3A%28from%3A%272022-11-13T00:00:00.000Z%27%2Cto%3A%272022-11-14T00:00:00.000Z%27%29%29"
1211 #dashboard_url
1212 behaves like returns the expected URL
1213 env: nil, expected_url: nil
1214 is expected to eq nil
1215 env: :pre, expected_url: pre_url
1216 is expected to eq "https://nonprod-log.gitlab.net/app/dashboards#/view/15596340-7570-11ed-9af2-6131f0ee4ce6?_g=%28time%...28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%27foo123%27%29%29%29%29%29"
1217 env: :production, expected_url: production_url
1218 is expected to eq "https://log.gprd.gitlab.net/app/dashboards#/view/5e6d3440-7597-11ed-9f43-e3784d7fe3ca?_g=%28time%3A%...28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%27foo123%27%29%29%29%29%29"
1219 env: :foo, expected_url: nil
1220 is expected to eq nil
1221 env: :staging, expected_url: staging_url
1222 is expected to eq "https://nonprod-log.gitlab.net/app/dashboards#/view/b74dc030-6f56-11ed-9af2-6131f0ee4ce6?_g=%28time%...28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%27foo123%27%29%29%29%29%29"
1223QA::Support::SSH
1224 #setup
1225 behaves like providing correct ports
1226 when no port specified in https uri
1227 does not provide port in ssh command
1228 when no port specified in uri
1229 does not provide port in ssh command
1230 when port 80 specified in uri
1231 does not provide port in ssh command
1232 when other port is specified in uri
1233 provides other port in ssh command
1234 #reset_2fa_codes
1235 behaves like providing correct ports
1236 when no port specified in uri
1237 does not provide port in ssh command
1238 when other port is specified in uri
1239 provides other port in ssh command
1240 when port 80 specified in uri
1241 does not provide port in ssh command
1242 when no port specified in https uri
1243 does not provide port in ssh command
1244 #git_user
1245 when running against environment on a port other than 80 or 443
1246 returns the local user
1247 when running on CI
1248 returns git user
1249 when running on a review app in CI
1250 returns git user
1251 when running against environment on port 80 and not on CI (docker)
1252 returns git user
1253QA::Runtime::API::Client
1254 #personal_access_token
1255 when user is nil and QA::Runtime::Env.personal_access_token is nil
1256 returns a created token
1257 when user is present and QA::Runtime::Env.personal_access_token is present
1258 returns a created token
1259 when user is nil and QA::Runtime::Env.personal_access_token is present
1260 returns specified token from env
1261 when user is present and QA::Runtime::Env.personal_access_token is nil
1262 returns a created token
1263 initialization
1264 uses specified address
1265 defaults to :gitlab address
1266QA::Runtime::Key::ECDSA
1267 #public_key
1268[Mar 28 2023 14:58:06 UTC (QA Tests)] INFO -- Executing: `ssh-keygen -t ecdsa -b 521 -f /tmp/d20230328-30-nqm4fd/id_ecdsa -N `
1269 generates a public 521-bits ECDSA key
1270[Mar 28 2023 14:58:06 UTC (QA Tests)] INFO -- Executing: `ssh-keygen -t ecdsa -b 256 -f /tmp/d20230328-30-zg9t5t/id_ecdsa -N `
1271 generates a public 256-bits ECDSA key
1272[Mar 28 2023 14:58:06 UTC (QA Tests)] INFO -- Executing: `ssh-keygen -t ecdsa -b 384 -f /tmp/d20230328-30-vh7dcy/id_ecdsa -N `
1273 generates a public 384-bits ECDSA key
1274 #new
1275[Mar 28 2023 14:58:06 UTC (QA Tests)] INFO -- Executing: `ssh-keygen -t ecdsa -b 123 -f /tmp/d20230328-30-a5x8bl/id_ecdsa -N `
1276[Mar 28 2023 14:58:06 UTC (QA Tests)] ERROR -- Command output:
1277Invalid ECDSA key length: valid lengths are 256, 384 or 521 bits
1278 does not support arbitrary bits
1279QA::Scenario::Test::Integration::LDAPNoServer
1280 #perform
1281 behaves like a QA scenario class
1282 performs before hooks only once
1283 responds to perform
1284 sets tags on runner
1285 with named command-line options
1286 passes on options after --
1287 raises an error if the option is invalid
1288 converts options to attributes
1289 with RSpec options
1290 sets options on runner
1291QA::Scenario::Test::Integration::LDAPTLS
1292 #perform
1293 behaves like a QA scenario class
1294 performs before hooks only once
1295 responds to perform
1296 sets tags on runner
1297 with named command-line options
1298 converts options to attributes
1299 raises an error if the option is invalid
1300 passes on options after --
1301 with RSpec options
1302 sets options on runner
1303QA::Support::Formatters::AllureMetadataFormatter
1304 with links
1305 adds quarantine, failure issue and ci job links
1306 with flaky test data
1307 with skipped spec
1308 skips adding flaky test data
1309 with non skipped spec
1310 adds flaky test data
1311QA::Runtime::Release
1312 when release version has extension strategy
1313 #version
1314 return either CE or EE version
1315 delegated class methods
1316 delegates all calls to strategy class
1317 #strategy
1318 return the strategy constant
1319QA::Scenario::Test::Sanity::Framework
1320 behaves like a QA scenario class
1321 performs before hooks only once
1322 sets tags on runner
1323 responds to perform
1324 with RSpec options
1325 sets options on runner
1326 with named command-line options
1327 passes on options after --
1328 converts options to attributes
1329 raises an error if the option is invalid
1330QA::Scenario::Test::Integration::LDAPNoTLS
1331 #perform
1332 behaves like a QA scenario class
1333 sets tags on runner
1334 responds to perform
1335 performs before hooks only once
1336 with RSpec options
1337 sets options on runner
1338 with named command-line options
1339 passes on options after --
1340 converts options to attributes
1341 raises an error if the option is invalid
1342QA::Resource::User
1343 #username
1344 is possible to set the username
1345 generates a default username
1346 #public_email
1347 defaults to QA::Runtime::User.default_email
1348 defaults to QA::Runtime::User.default_email if the public_email from the api_resource is blank
1349 retrieves the public_email from the api_resource if present
1350 #name
1351 retrieves the name from the api_resource if present
1352 is possible to set the name
1353 defaults to a name based on the username
1354 #email
1355 is possible to set the email
1356 defaults to the <username>@example.com
1357 #credentials_given?
1358 returns true if both the username and password have been overridden
1359 returns false if only the password has been overridden
1360 returns false if only the username has been overridden
1361 returns false even after username and email have been called
1362 returns false when username and email have not been overridden
1363 #password
1364 is possible to set the password
1365 generates a default password
1366 #fabricate_or_use
1367 when signup_disabled is false, personal_access_tokens_disabled is true, calls fabricate!, does not call fabricate_via_api!
1368 when signup_disabled is true, personal_access_tokens_disabled is false, calls fabricate_via_api!, does not call fabricate!
1369 when signup_disabled is false, personal_access_tokens_disabled is false, calls fabricate!, does not call fabricate_via_api!
1370 when signup_disabled is true, personal_access_tokens_disabled is true, calls fabricate!, does not call fabricate_via_api!
1371 #has_user?
1372 returns true when has_username returns true
1373 returns false when has_username returns false
1374QA::Runtime::Scenario
1375 replaces an existing attribute
1376 raises error when attribute is empty
1377 raises error when attribute is not known
1378 makes it possible to define global scenario attributes
1379QA::Runtime::API::Request
1380 #request_path
1381 adds the oauth access token
1382 prepends the api path
1383 adds the personal access token
1384 uses a different api version
1385 respects query parameters
1386 #mask_url
1387 returns the full API request url with the token masked
1388 #url
1389 returns the full API request url
1390 when oauth_access_token is passed in the query string
1391 does not adds a private_token query string
1392QA::Scenario::Test::Instance::Reliable
1393 behaves like a QA scenario class
1394 sets tags on runner
1395 responds to perform
1396 performs before hooks only once
1397 with RSpec options
1398 sets options on runner
1399 with named command-line options
1400 raises an error if the option is invalid
1401 converts options to attributes
1402 passes on options after --
1403QA::Scenario::Template
1404 ensures a disabled feature is not enabled afterwards if it was disabled earlier
1405 defines klass attribute
1406 does not disable a feature if already disabled
1407 ensures a disabled feature is enabled afterwards
1408 defines gitlab address from positional argument
1409 ensures an enabled feature is disabled afterwards
1410 allows a feature to be enabled
1411 defaults to gitlab address from env
1412 allows a feature to be disabled
1413QA::Specs::Helpers::ContextSelector
1414 outputs a message for invalid environments
1415 runs only in staging
1416 with pipeline constraints
1417 when a pipeline triggered from the default branch runs in gitlab-qa
1418 runs on default branch pipelines
1419 when excluding contexts
1420 skips default branch pipelines
1421 with CI_PROJECT_NAME set
1422 runs on designated pipeline
1423 when excluding contexts
1424 skips designated pipeline
1425 without CI_PROJECT_NAME set
1426 runs on any pipeline
1427 when excluding contexts
1428 runs in any pipeline
1429 production
1430 runs on production
1431 when excluding contexts
1432 skips production
1433 custom env
1434 runs on a custom environment
1435 when excluding contexts
1436 skips a custom environment
1437 jh hk production
1438 runs on production
1439 when excluding contexts
1440 skips production
1441 staging-ref
1442 runs on staging-ref
1443 .context_matches?
1444 returns false for mismatching
1445 returns true when url has .com
1446 returns false when url does not have .com
1447 with arguments
1448 matches :production on jh side
1449 matches domain
1450 matches multiple subdomains
1451 matches tld
1452 doesnt match with mismatching switches
1453 matches multiple subdomains on jh side
1454 matches :production
1455 matches domain on jh side
1456 returns true when :subdomain is set
1457 with job constraints
1458 without CI_JOB_NAME set
1459 when including only specific contexts
1460 runs in any job
1461 when excluding contexts
1462 runs in any job
1463 with CI_JOB_NAME set
1464 when including only specific contexts
1465 runs only in the specified jobs
1466 does not run in jobs that do not match
1467 when excluding contexts
1468 runs in jobs that do not match
1469 does not run in the specified job
1470 when excluding contexts
1471 skips staging
1472 jh mainland production
1473 runs on production
1474 when excluding contexts
1475 skips production
1476 description and context blocks
1477 with environment set
1478 can apply to contexts or descriptions
1479 when excluding contexts
1480 can apply to contexts or descriptions
1481 with different environment set on jh side
1482 does not run against production
1483 when excluding contexts
1484 runs against production
1485 with different environment set
1486 does not run against production
1487 when excluding contexts
1488 runs against production
1489QA::Resource::Repository::Push
1490 .files=
1491 does not raise if files is an array of hashes with :name and :content keys
1492 raises an error if files is not an array
1493 raises an error if files is an empty array
1494 raises an error if files is not an array of hashes with :name and :content keys
1495QA::Page::Base
1496 page helpers
1497 exposes helpful page helpers
1498 .view DSL for defining view partials
1499 makes it possible to define page views
1500 populates views objects with data about elements
1501 elements
1502 #required_elements
1503 returns only required elements
1504 #visible? Page is currently visible
1505 with elements
1506 with element not on the page
1507 is not visible
1508 with element on the page
1509 does not raise error if page has elements
1510 is visible
1511 with no elements
1512 raises error if page has no required elements
1513 #elements
1514 returns all elements
1515 #all_elements
1516 raises an error if count or minimum are not specified
1517 does not raise an error if :minimum, :maximum, :count, or :between is specified
1518 #wait_until
1519 when the condition is true
1520 does not refresh
1521 returns true
1522 when the condition is false
1523 refreshes
1524 returns false
1525 .errors
1526 when page has no views and elements defined
1527 appends an error about missing views / elements block
1528 when page has views and elements defined
1529 iterates views composite and returns errors
1530QA::Scenario::Test::Integration::Mattermost
1531 #perform
1532 behaves like a QA scenario class
1533 responds to perform
1534 performs before hooks only once
1535 sets tags on runner
1536 with RSpec options
1537 sets options on runner
1538 with named command-line options
1539 passes on options after --
1540 converts options to attributes
1541 raises an error if the option is invalid
1542QA::Runtime::Key::ED25519
1543 #public_key
1544[Mar 28 2023 14:58:06 UTC (QA Tests)] INFO -- Executing: `ssh-keygen -t ed25519 -b 256 -f /tmp/d20230328-30-p39sa4/id_ed25519 -N `
1545 generates a public ED25519 key
1546QA::Runtime::Namespace
1547 .path
1548 is always cached
1549 .name
1550 when CACHE_NAMESPACE_NAME is defined
1551 caches name by default
1552 does not cache name when reset_cache is true
1553 caches name when reset_cache is false
1554 when CACHE_NAMESPACE_NAME is not defined
1555 caches name by default
1556 does not cache name when reset_cache is true
1557QA::Scenario::Test::Instance::All
1558 behaves like a QA scenario class
1559 sets tags on runner
1560 performs before hooks only once
1561 responds to perform
1562 with RSpec options
1563 sets options on runner
1564 with named command-line options
1565 passes on options after --
1566 converts options to attributes
1567 raises an error if the option is invalid
1568QA::Support::SystemLogs::Sentry
1569 #url
1570 env: nil, expected_url: nil
1571 returns the expected URL
1572 env: :foo, expected_url: nil
1573 returns the expected URL
1574 env: :pre, expected_url: pre_url
1575 returns the expected URL
1576 env: :staging, expected_url: staging_url
1577 returns the expected URL
1578 env: :production, expected_url: production_url
1579 returns the expected URL
1580 env: :staging_ref, expected_url: staging_ref_url
1581 returns the expected URL
1582QA::Git::Location
1583 .new
1584 when URI starts with ssh://
1585 when URI does not have port
1586 parses correctly
1587 when URI has port
1588 parses correctly
1589 when URI does not start with ssh://
1590 when host has a colon
1591 parses correctly
1592 when host does not have colons
1593 parses correctly
1594QA::Support::Waiter
1595 .wait_until
1596 sets max_duration to 60 by default
1597 allows logs to be silenced
1598 sets raise_on_failure to true by default
1599 sets sleep_interval to 0.1 by default
1600 sets retry_on_exception to false by default
1601Interceptor
1602 with Interceptor
1603 with caching
1604 checks the cache (PENDING: Only can test for chrome)
1605 returns false if the cache cannot be accessed (PENDING: Only can test for chrome)
1606 gets and sets the cache data (PENDING: Only can test for chrome)
1607 when intercepting
1608 intercepts fetch errors (PENDING: Only can test for chrome)
1609 intercepts xhr (PENDING: Only can test for chrome)
1610Pending: (Failures listed here are expected and do not affect your suite's status)
1611 1) Interceptor with Interceptor with caching checks the cache
1612 # Only can test for chrome
1613 # ./spec/runtime/script_extensions/interceptor_spec.rb:31
1614 2) Interceptor with Interceptor with caching returns false if the cache cannot be accessed
1615 # Only can test for chrome
1616 # ./spec/runtime/script_extensions/interceptor_spec.rb:35
1617 3) Interceptor with Interceptor with caching gets and sets the cache data
1618 # Only can test for chrome
1619 # ./spec/runtime/script_extensions/interceptor_spec.rb:41
1620 4) Interceptor with Interceptor when intercepting intercepts fetch errors
1621 # Only can test for chrome
1622 # ./spec/runtime/script_extensions/interceptor_spec.rb:51
1623 5) Interceptor with Interceptor when intercepting intercepts xhr
1624 # Only can test for chrome
1625 # ./spec/runtime/script_extensions/interceptor_spec.rb:62
1626Finished in 3.36 seconds (files took 1.96 seconds to load)
1627758 examples, 0 failures, 5 pending
1628Randomized with seed 43794
1629 Saving cache for successful job 00:01
1630Not uploading cache qa-ruby-gems-debian-bullseye-ruby-3.0-cb64bd903f4eb012a7ececfc89cb0998ad044785-16 due to policy
1631 Cleaning up project directory and file based variables 00:01
1632Job succeeded