qa:internal

Passed Started 3 years ago by
1Running with gitlab-runner 14.1.0-rc1 (e9489c8a)
2  on docker-auto-scale-com 8a6210b8
3  feature flags: FF_USE_FASTZIP:true
 4  Resolving secrets  
  00:00
 5  Preparing the "docker+machine" executor  
  00:36
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images:ruby-2.7.2.patched-golang-1.14-git-2.31-lfs-2.9-chrome-89-node-14.15-yarn-1.22-postgresql-11-graphicsmagick-1.3.36 ...
7Authenticating with credentials from job payload (GitLab Registry)
8Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:ruby-2.7.2.patched-golang-1.14-git-2.31-lfs-2.9-chrome-89-node-14.15-yarn-1.22-postgresql-11-graphicsmagick-1.3.36 ...
9Using docker image sha256:9b06bf3dd0ab8d484e8c9e9c611f75eab098939f568d587a7fd23a3c96eceb87 for registry.gitlab.com/gitlab-org/gitlab-build-images:ruby-2.7.2.patched-golang-1.14-git-2.31-lfs-2.9-chrome-89-node-14.15-yarn-1.22-postgresql-11-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:eb4fdeb3196481dd022d7d166468834e40a046b46a29e3349fb3bf3657176290 ...
 10  Preparing environment  
  00:04
11Running on runner-8a6210b8-project-278964-concurrent-0 via runner-8a6210b8-gsrm-1626788175-8d0297e0...
 12  Getting source from Git repository  
  00:30
13$ eval "$CI_PRE_CLONE_SCRIPT"
14Downloading archived master...
15Connecting to storage.googleapis.com (172.217.193.128:443)
16saving to '/tmp/gitlab.tar.gz'
17gitlab.tar.gz         50% |****************                |  189M  0:00:00 ETA
18gitlab.tar.gz        100% |********************************|  373M  0:00:00 ETA
19'/tmp/gitlab.tar.gz' saved
20Extracting tarball into /builds/gitlab-org/gitlab...
21Fetching changes with git depth set to 20...
22Reinitialized existing Git repository in /builds/gitlab-org/gitlab/.git/
23Created fresh repository.
24remote: Enumerating objects: 237, done.        
25remote: Counting objects: 100% (159/159), done.        
26remote: Compressing objects: 100% (60/60), done.        
27remote: Total 77 (delta 58), reused 33 (delta 16), pack-reused 0        
28From https://gitlab.com/gitlab-org/gitlab
29 * [new ref]               3f8443f21d8eddb0895bed8fa7e421d67e3ceb67 -> refs/pipelines/340061394
30Checking out 3f8443f2 as refs/merge-requests/66303/merge...
31Skipping Git submodules setup
 32  Restoring cache  
  00:03
33Checking cache for qa-ruby-gems-v1-4...
34Downloading cache.zip from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/qa-ruby-gems-v1-4 
35Successfully extracted cache
 36  Executing "step_script" stage of the job script  
  00:09
37Using docker image sha256:9b06bf3dd0ab8d484e8c9e9c611f75eab098939f568d587a7fd23a3c96eceb87 for registry.gitlab.com/gitlab-org/gitlab-build-images:ruby-2.7.2.patched-golang-1.14-git-2.31-lfs-2.9-chrome-89-node-14.15-yarn-1.22-postgresql-11-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:eb4fdeb3196481dd022d7d166468834e40a046b46a29e3349fb3bf3657176290 ...
38$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
39$ export GOPATH=$CI_PROJECT_DIR/.go
40$ mkdir -p $GOPATH
41$ source scripts/utils.sh
42$ source scripts/prepare_build.sh
43$ cd qa/
44$ bundle_install_script
45Bundler version 2.1.4
46production:development
47Settings are listed in order of priority. The top value will be used.
48path
49Set for the current user (/root/.bundle/config): "vendor"
50clean
51Set for the current user (/root/.bundle/config): "true"
52without
53Set via BUNDLE_WITHOUT: [:production, :development]
54install_flags
55Set via BUNDLE_INSTALL_FLAGS: "--jobs=$(nproc) --retry=3 --quiet"
56$ bundle install --jobs=$(nproc) --retry=3 --quiet  && bundle check
57Warning: the running version of Bundler (2.1.4) is older than the version that created the lockfile (2.2.22). We suggest you to upgrade to the version that created the lockfile by running `gem install bundler:2.2.22`.
58The Gemfile's dependencies are satisfied
59==> 'bundle install --jobs=$(nproc) --retry=3 --quiet  && bundle check' succeeded in 1 seconds.
60Could not find gem 'pg'.
61$ bundle exec rspec
62warning: parser/current is loading parser/ruby27, which recognizes
63warning: 2.7.1-compliant syntax, but you are running 2.7.2.
64warning: please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
65/builds/gitlab-org/gitlab/qa/vendor/ruby/2.7.0/gems/chemlab-0.7.2/lib/chemlab/configuration.rb:79: warning: already initialized constant Chemlab::Vendor
66/builds/gitlab-org/gitlab/qa/vendor/ruby/2.7.0/gems/chemlab-0.7.2/lib/chemlab/configuration.rb:79: warning: previous definition of Vendor was here
672021-07-20 14:59:47 / CONF	:: 
68      ==> Base URL: 
69      ==> Browser: #<Selenium::WebDriver::Chrome::Driver:0x00007f981229bd80>
70      ==> Libraries: Chemlab::Vendor
71Randomized with seed 56334
72QA::Git::Location
73  .new
74    when URI does not start with ssh://
75      when host does not have colons
76        parses correctly
77      when host has a colon
78        parses correctly
79    when URI starts with ssh://
80      when URI does not have port
81        parses correctly
82      when URI has port
83        parses correctly
84QA::Git::Repository
85  with default credentials
86    #delete_tag
87      behaves like command with retries
88        when command is not successful the first time
89          and retried command is successful
90            retries the command twice and returns the successful #run command Result output
91          and retried command is not successful after 3 attempts
92            raises a CommandError exception
93        when command is successful
94          returns the #run command Result output
95    #clone
96      when opts is given
97        behaves like command with retries
98          when command is successful
99            returns the #run command Result output
100          when command is not successful the first time
101            and retried command is not successful after 3 attempts
102              raises a CommandError exception
103            and retried command is successful
104              retries the command twice and returns the successful #run command Result output
105      when no opts is given
106        behaves like command with retries
107          when command is successful
108            returns the #run command Result output
109          when command is not successful the first time
110            and retried command is not successful after 3 attempts
111              raises a CommandError exception
112            and retried command is successful
113              retries the command twice and returns the successful #run command Result output
114    #git_protocol=
115      configures git to use protocol version 1
116      configures git to use protocol version 0
117      raises an error if the version is unsupported
118      configures git to use protocol version 2
119    #use_default_credentials
120      adds credentials to .netrc
121    #fetch_supported_git_protocol
122      reports the detected version
123      reports unknown if content does not identify a version
124      reports unknown if version is unknown
125      behaves like command with retries
126        when command is successful
127          returns the #run command Result output
128        when command is not successful the first time
129          and retried command is successful
130            retries the command twice and returns the successful #run command Result output
131          and retried command is not successful after 3 attempts
132            raises a CommandError exception
133    #push_changes
134      with push options
135        when set to create a merge request
136          behaves like command with retries
137            when command is successful
138              returns the #run command Result output
139            when command is not successful the first time
140              and retried command is not successful after 3 attempts
141                raises a CommandError exception
142              and retried command is successful
143                retries the command twice and returns the successful #run command Result output
144        when a label is given
145          behaves like command with retries
146            when command is not successful the first time
147              and retried command is successful
148                retries the command twice and returns the successful #run command Result output
149              and retried command is not successful after 3 attempts
150                raises a CommandError exception
151            when command is successful
152              returns the #run command Result output
153        when description is given
154          behaves like command with retries
155            when command is not successful the first time
156              and retried command is not successful after 3 attempts
157                raises a CommandError exception
158              and retried command is successful
159                retries the command twice and returns the successful #run command Result output
160            when command is successful
161              returns the #run command Result output
162        when set to remove source branch
163          behaves like command with retries
164            when command is successful
165              returns the #run command Result output
166            when command is not successful the first time
167              and retried command is successful
168                retries the command twice and returns the successful #run command Result output
169              and retried command is not successful after 3 attempts
170                raises a CommandError exception
171        when two labels are given
172          behaves like command with retries
173            when command is successful
174              returns the #run command Result output
175            when command is not successful the first time
176              and retried command is successful
177                retries the command twice and returns the successful #run command Result output
178              and retried command is not successful after 3 attempts
179                raises a CommandError exception
180        when target branch is given
181          behaves like command with retries
182            when command is not successful the first time
183              and retried command is successful
184                retries the command twice and returns the successful #run command Result output
185              and retried command is not successful after 3 attempts
186                raises a CommandError exception
187            when command is successful
188              returns the #run command Result output
189        when set to merge when pipeline succeeds
190          behaves like command with retries
191            when command is successful
192              returns the #run command Result output
193            when command is not successful the first time
194              and retried command is successful
195                retries the command twice and returns the successful #run command Result output
196              and retried command is not successful after 3 attempts
197                raises a CommandError exception
198        when title is given
199          behaves like command with retries
200            when command is not successful the first time
201              and retried command is not successful after 3 attempts
202                raises a CommandError exception
203              and retried command is successful
204                retries the command twice and returns the successful #run command Result output
205            when command is successful
206              returns the #run command Result output
207      when no branch is given
208        behaves like command with retries
209          when command is successful
210            returns the #run command Result output
211          when command is not successful the first time
212            and retried command is successful
213              retries the command twice and returns the successful #run command Result output
214            and retried command is not successful after 3 attempts
215              raises a CommandError exception
216      when branch is given
217        behaves like command with retries
218          when command is successful
219            returns the #run command Result output
220          when command is not successful the first time
221            and retried command is successful
222              retries the command twice and returns the successful #run command Result output
223            and retried command is not successful after 3 attempts
224              raises a CommandError exception
225    #shallow_clone
226      behaves like command with retries
227        when command is successful
228          returns the #run command Result output
229        when command is not successful the first time
230          and retried command is successful
231            retries the command twice and returns the successful #run command Result output
232          and retried command is not successful after 3 attempts
233            raises a CommandError exception
234  with specific credentials
235    before setting credentials
236      does not add credentials to .netrc
237    #password=
238      adds credentials to .netrc
239      adds credentials with special characters
240      raises an error if no username was given
241QA::Specs::Helpers::ContextSelector
242  outputs a message for invalid environments
243  runs only in staging
244  with pipeline constraints
245    without CI_PROJECT_NAME set
246      runs on any pipeline
247      when excluding contexts
248        runs in any pipeline
249    when a pipeline triggered from the default branch runs in gitlab-qa
250      runs on default branch pipelines
251      when excluding contexts
252        skips default branch pipelines
253    with CI_PROJECT_NAME set
254      runs on designated pipeline
255      when excluding contexts
256        skips designated pipeline
257  description and context blocks
258    with environment set
259      can apply to contexts or descriptions
260      when excluding contexts
261        can apply to contexts or descriptions
262    with different environment set
263      does not run against production
264      when excluding contexts
265        runs against production
266  when excluding contexts
267    skips staging
268  production
269    runs on production
270    when excluding contexts
271      skips production
272  with job constraints
273    with CI_JOB_NAME set
274      when including only specific contexts
275        runs only in the specified jobs
276        does not run in jobs that do not match
277      when excluding contexts
278        does not run in the specified job
279        runs in jobs that do not match
280    without CI_JOB_NAME set
281      when excluding contexts
282        runs in any job
283      when including only specific contexts
284        runs in any job
285  custom env
286    runs on a custom environment
287    when excluding contexts
288      skips a custom environment
289  .context_matches?
290    returns true when url has .com
291    returns false when url does not have .com
292    returns false for mismatching
293    with arguments
294      doesnt match with mismatching switches
295      returns true when :subdomain is set
296      matches :production
297      matches multiple subdomains
298QA::Page::Validator
299  #constants
300    returns all constants that are module children
301  #descendants
302    recursively returns all descendants that are page objects
303    does not return modules that aggregate page objects
304  when checking validation errors
305    when there are validation errors
306      #validate!
307        raises validation error
308      #errors
309        returns errors
310    when there are no validation errors
311      #errors
312        does not return errors
313      #validate!
314        does not raise error
315QA::Resource::User
316  #fabricate_via_api!
317    fetches an existing user
318    tries to create a user if it does not exist
319QA::Runtime::Key::ECDSA
320  #public_key
321Executing `["ssh-keygen", "-t", "ecdsa", "-b", "521", "-f", "/tmp/d20210720-49-19tmj6n/id_ecdsa", "-N", ""]`
322Generating public/private ecdsa key pair.
323Your identification has been saved in /tmp/d20210720-49-19tmj6n/id_ecdsa.
324Your public key has been saved in /tmp/d20210720-49-19tmj6n/id_ecdsa.pub.
325The key fingerprint is:
326SHA256:8hf+MvXG5MrdDxBGjSEn2itvpgjcZFgH2rrJ85pGxrs root@runner-8a6210b8-project-278964-concurrent-0
327The key's randomart image is:
328+---[ECDSA 521]---+
329|      .   o ++   |
330|     o . o =. .  |
331|    . o o . o    |
332|     + .   o .   |
333|   .o + S o .    |
334|   o+* o + ....  |
335|   oB.. . *. =.  |
336|    o= . =oo .=o |
337|   .Eoo .  o+o. +|
338+----[SHA256]-----+
339    generates a public 521-bits ECDSA key
340Executing `["ssh-keygen", "-t", "ecdsa", "-b", "256", "-f", "/tmp/d20210720-49-h2vpom/id_ecdsa", "-N", ""]`
341Generating public/private ecdsa key pair.
342Your identification has been saved in /tmp/d20210720-49-h2vpom/id_ecdsa.
343Your public key has been saved in /tmp/d20210720-49-h2vpom/id_ecdsa.pub.
344The key fingerprint is:
345SHA256:TamtUjQDqhR5YS2Gd6yKun6/cyyvaSgaY+4M9ktDmuo root@runner-8a6210b8-project-278964-concurrent-0
346The key's randomart image is:
347+---[ECDSA 256]---+
348|  .oo+.          |
349|  oo=.+.   .     |
350|  .+.+  + o      |
351| . ..  . B       |
352| ..o    S o      |
353|. =    . .       |
354|== o. o .        |
355|O+oo.+.+         |
356|OEoo+=B.         |
357+----[SHA256]-----+
358    generates a public 256-bits ECDSA key
359Executing `["ssh-keygen", "-t", "ecdsa", "-b", "384", "-f", "/tmp/d20210720-49-kpu90u/id_ecdsa", "-N", ""]`
360Generating public/private ecdsa key pair.
361Your identification has been saved in /tmp/d20210720-49-kpu90u/id_ecdsa.
362Your public key has been saved in /tmp/d20210720-49-kpu90u/id_ecdsa.pub.
363The key fingerprint is:
364SHA256:Yp1UU36WzfE5wCVV0XJ4IG6LeIIYcwwywNpghasYDaE root@runner-8a6210b8-project-278964-concurrent-0
365The key's randomart image is:
366+---[ECDSA 384]---+
367|+o=..     o.+o+B=|
368|++ o o   . + o=+B|
369|E=. o o .   + +*+|
370|o.o  = + o o +  .|
371|o.  . + S o .    |
372|o    . . o       |
373|                 |
374|                 |
375|                 |
376+----[SHA256]-----+
377    generates a public 384-bits ECDSA key
378  #new
379Executing `["ssh-keygen", "-t", "ecdsa", "-b", "123", "-f", "/tmp/d20210720-49-1vpvayu/id_ecdsa", "-N", ""]`
380Invalid ECDSA key length: valid lengths are 256, 384 or 521 bits
381    does not support arbitrary bits
382QA::Runtime::Scenario
383  raises error when attribute is empty
384  makes it possible to define global scenario attributes
385  raises error when attribute is not known
386  replaces an existing attribute
387QA::Resource::Events::Base
388  #events
389    fetches all events when called without parameters
390    fetches events with a specified action type
391QA::Scenario::Test::Instance::Smoke
392  behaves like a QA scenario class
393    sets an address of the subject
394    performs before hooks only once
395    responds to perform
396    sets tags on runner
397    specifying RSpec options
398      sets options on runner
399    with named command-line options
400      converts options to attributes
401      passes on options after --
402      raises an error if the option is invalid
403QA::Service::DockerRun::K3s
404  #host_name
405    not in CI
406      returns localhost if not running in a CI environment
407    in CI
408      returns name.network
409QA::Scenario::Test::Sanity::Framework
410  behaves like a QA scenario class
411    sets tags on runner
412    responds to perform
413    performs before hooks only once
414    sets an address of the subject
415    with named command-line options
416      passes on options after --
417      converts options to attributes
418      raises an error if the option is invalid
419    specifying RSpec options
420      sets options on runner
421QA::Scenario::Test::Integration::Mattermost
422  #perform
423    behaves like a QA scenario class
424      requires a GitHub access token
425      performs before hooks only once
426      sets an address of the subject
427      responds to perform
428      sets tags on runner
429      with named command-line options
430        converts options to attributes
431        raises an error if the option is invalid
432        passes on options after --
433      specifying RSpec options
434        sets options on runner
435QA::Runtime::API::Request
436  #request_path
437    uses a different api version
438    prepends the api path
439    respects query parameters
440    adds the personal access token
441    adds the oauth access token
442  #mask_url
443    returns the full API request url with the token masked
444  #url
445    returns the full API request url
446    when oauth_access_token is passed in the query string
447      does not adds a private_token query string
448QA::Scenario::Test::Integration::LDAPNoServer
449  #perform
450    behaves like a QA scenario class
451      sets an address of the subject
452      performs before hooks only once
453      sets tags on runner
454      responds to perform
455      with named command-line options
456        converts options to attributes
457        passes on options after --
458        raises an error if the option is invalid
459      specifying RSpec options
460        sets options on runner
461QA::Scenario::Bootable
462  makes it possible to define the scenario attribute
463  does not require attributes to be defined
464QA::Specs::ParallelRunner
465  passes args to parallel_tests
466  passes tags and test paths with separators to parallel_tests
467  passes tags and test paths to parallel_tests and adds a separator
468  passes supported environment variables
469  passes a given test path to parallel_tests and adds a separator
470QA::Runtime::Key::ED25519
471  #public_key
472Executing `["ssh-keygen", "-t", "ed25519", "-b", "256", "-f", "/tmp/d20210720-49-1qvuznt/id_ed25519", "-N", ""]`
473Generating public/private ed25519 key pair.
474Your identification has been saved in /tmp/d20210720-49-1qvuznt/id_ed25519.
475Your public key has been saved in /tmp/d20210720-49-1qvuznt/id_ed25519.pub.
476The key fingerprint is:
477SHA256:cPMEAXnsfSOUenxcIQZtNUGxR5wY+2qw/TwavP9bjzw root@runner-8a6210b8-project-278964-concurrent-0
478The key's randomart image is:
479+--[ED25519 256]--+
480|      .+o..+o+X=o|
481|      . o.o.ooo=.|
482|      .oo=.o o. .|
483|       oo+= = .. |
484|        S..= . . |
485|            = .  |
486|           . *  .|
487|            ..Eoo|
488|             o=**|
489+----[SHA256]-----+
490    generates a public ED25519 key
491QA::Resource::Base
492  #web_url
493    sets #web_url to #current_url after fabrication
494  .fabricate!
495    when resource does not support fabrication via the API
496      calls .fabricate_via_browser_ui!
497    when resource supports fabrication via the API
498      calls .fabricate_via_browser_ui!
499  .attribute
500    when the attribute has no value
501      raises an error because no values could be found
502    when the attribute is populated via direct assignment
503      returns value from the assignment
504      when the api also has such response
505        returns value from the assignment
506    when the attribute is populated via the api
507      returns value from api
508      when the attribute also has a block
509        returns value from api and emits an INFO log entry
510    when multiple resources have the same attribute name
511      has unique attribute values
512    when the attribute is populated via a block
513      returns value from the block
514  #visit!
515    calls #visit with the underlying #web_url
516  .fabricate_via_browser_ui!
517    instantiates the resource and calls resource method
518    logs the resource and build method when QA_DEBUG=true
519    returns fabrication resource
520    behaves like fabrication method
521      does not log the resource and build method when QA_DEBUG=false
522      yields resource before calling resource method
523  .fabricate_via_api!
524    instantiates the resource, calls resource method returns the resource
525    logs the resource and build method when QA_DEBUG=true
526    behaves like fabrication method
527      does not log the resource and build method when QA_DEBUG=false
528      yields resource before calling resource method
529QA::Page::View
530  .evaluate
531    evaluates a block and returns a DSL object
532  #pathname
533    returns an absolute and clean path to the view
534  #errors
535    when view partial has not been found
536      returns an error when it is not able to find the partial
537    when view partial is present
538      when pattern is found
539        walks through the view and asserts on elements existence
540      when pattern has not been found
541        returns an array of errors related to missing elements
542QA::Scenario::Test::Integration::LDAPNoTLS
543  #perform
544    behaves like a QA scenario class
545      performs before hooks only once
546      responds to perform
547      sets tags on runner
548      sets an address of the subject
549      specifying RSpec options
550        sets options on runner
551      with named command-line options
552        raises an error if the option is invalid
553        converts options to attributes
554        passes on options after --
555QA::Specs::Runner
556  #perform
557    when "qa/specs/features/foo" is set as options
558      passes the given tests path and excludes the orchestrated, transient, and geo tags
559    when "--tag smoke" is set as options
560      focuses on the given tag without excluded tags
561    when tags are set
562      focuses on the given tags
563    when SIGNUP_DISABLED is true
564      includes default args and excludes the skip_signup_disabled tag
565    when "--tag smoke" and "qa/specs/features/foo" are set as options
566      focuses on the given tag and includes the path without excluding the orchestrated or transient tags
567    testable features
568      when only git protocol 2 is supported
569        behaves like one supported feature
570          includes default args and excludes all unsupported tags
571      when all features are supported
572        behaves like excludes orchestrated, transient, and geo
573          excludes the orchestrated, transient, and geo tags, and includes default args
574      when features are not specified
575        behaves like excludes orchestrated, transient, and geo
576          excludes the orchestrated, transient, and geo tags, and includes default args
577      when no features are supported
578        behaves like one supported feature
579          includes default args and excludes all unsupported tags
580      when only admin features are supported
581        behaves like one supported feature
582          includes default args and excludes all unsupported tags
583    when running against live environment
584      includes default args and excludes the skip_live_env tag
585    when running against a Geo environment
586      includes the geo tag
587    when tty is set
588      sets the `--tty` flag
589    behaves like excludes orchestrated, transient, and geo
590      excludes the orchestrated, transient, and geo tags, and includes default args
591QA::Runtime::Release
592  when release version does not have extension strategy
593    delegated class methods
594      raises error
595    #strategy
596      raises error
597  when release version has extension strategy
598    delegated class methods
599      delegates all calls to strategy class
600    #strategy
601      return the strategy constant
602    #version
603      return either CE or EE version
604QA::Resource::Repository::Push
605  .files=
606    raises an error if files is not an array
607    raises an error if files is an empty array
608    does not raise if files is an array of hashes with :name and :content keys
609    raises an error if files is not an array of hashes with :name and :content keys
610QA::Scenario::Test::Instance::Airgapped
611  #perform
612    behaves like a QA scenario class
613      responds to perform
614      performs before hooks only once
615      sets tags on runner
616      sets an address of the subject
617      specifying RSpec options
618        sets options on runner
619      with named command-line options
620        converts options to attributes
621        passes on options after --
622        raises an error if the option is invalid
623QA::Resource::Events::Project
624  #wait_for_push
625    raises an error if a push with the specified commit message is not found
626    waits for a push with a specified commit message
627  #wait_for_push_new_branch
628    waits for a push to the given branch
629    raises an error if a push with the specified branch is not found
630    waits for a push to the default branch if no branch is given
631QA::EE::Runtime::Geo
632  .max_file_replication_time
633    when the environment variable is set
634      returns the environment variable as a float
635    when the environment variable is not set
636      returns the default
637  .max_db_replication_time
638    when the environment variable is not set
639      returns the default
640    when the environment variable is set
641      returns the environment variable as a float
642QA::Page::Element
643  #selector_css
644    transforms element name into QA-specific clickable css selector
645  attributes
646    element with a pattern
647      has an attribute[pattern] of the pattern
648      is not required by default
649    element with requirement and pattern
650      has a selector of the name
651      has an attribute[pattern] of the passed pattern
652      is required
653    element with no args
654      defaults pattern to #selector
655      is not required by default
656    element with requirement; no pattern
657      has an attribute[pattern] of the selector
658      is required
659  data-qa selectors
660    properly translates to a data-qa-selector
661    additional selectors
662      translates snake_case to kebab-case
663      matches on additional data-qa properties
664      doesnt conflict with element requirement
665  when pattern is an expression
666    does not match if pattern is not present
667    matches when there is a match
668  #selector
669    transforms element name into QA-specific selector
670  when pattern is not provided
671    matches when element name is specified
672    does not match if QA selector is not there
673    matches when QA specific selector is present
674  when pattern is a string
675    matches when there is match
676    does not match if pattern is not present
677QA::Support::Repeater
678  .repeat_until
679    logs attempts
680D, [2021-07-20T14:59:49.387618 #49] DEBUG -- : 
681Starting test: QA::Support::Repeater.repeat_until allows logging to be silenced
682    allows logging to be silenced
683    when raise_on_failure is false
684      when retry_on_exception is true
685        when max duration is not reached
686D, [2021-07-20T14:59:49.389060 #49] DEBUG -- : 
687Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is true when max duration is not reached does not raise an exception
688          does not raise an exception
689D, [2021-07-20T14:59:49.390129 #49] DEBUG -- : 
690Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is true when max duration is not reached returns the value from the block
691          returns the value from the block
692        when max duration is reached
693D, [2021-07-20T14:59:49.391216 #49] DEBUG -- : 
694Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is true when max duration is reached does not raise an exception
695          does not raise an exception
696D, [2021-07-20T14:59:49.392134 #49] DEBUG -- : 
697Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is true when max duration is reached returns the value from the block
698          returns the value from the block
699        when both max_attempts and max_duration are provided
700          when max_duration is reached first
701            behaves like repeat until
702D, [2021-07-20T14:59:49.393459 #49] DEBUG -- : 
703Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is true when both max_attempts and max_duration are provided when max_duration is reached first behaves like repeat until returns when max_duration is reached
704D, [2021-07-20T14:59:49.393532 #49] DEBUG -- : Attempt number 1
705              returns when max_duration is reached
706          when max_attempts is reached first
707            behaves like repeat until
708D, [2021-07-20T14:59:49.394775 #49] DEBUG -- : 
709Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is true when both max_attempts and max_duration are provided when max_attempts is reached first behaves like repeat until returns when max_attempts is reached
710D, [2021-07-20T14:59:49.394851 #49] DEBUG -- : Attempt number 1
711              returns when max_attempts is reached
712      when retry_on_exception is not provided (default: false)
713        when max duration is not reached
714D, [2021-07-20T14:59:49.396178 #49] DEBUG -- : 
715Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is not provided (default: false) when max duration is not reached returns the value from the block
716          returns the value from the block
717D, [2021-07-20T14:59:49.397063 #49] DEBUG -- : 
718Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is not provided (default: false) when max duration is not reached raises an exception
719          raises an exception
720        when both max_attempts and max_duration are provided
721          when max_duration is reached first
722            behaves like repeat until
723D, [2021-07-20T14:59:49.398457 #49] DEBUG -- : 
724Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is not provided (default: false) when both max_attempts and max_duration are provided when max_duration is reached first behaves like repeat until returns when max_duration is reached
725D, [2021-07-20T14:59:49.398529 #49] DEBUG -- : Attempt number 1
726              returns when max_duration is reached
727          when max_attempts is reached first
728            behaves like repeat until
729D, [2021-07-20T14:59:49.399815 #49] DEBUG -- : 
730Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is not provided (default: false) when both max_attempts and max_duration are provided when max_attempts is reached first behaves like repeat until returns when max_attempts is reached
731D, [2021-07-20T14:59:49.399886 #49] DEBUG -- : Attempt number 1
732              returns when max_attempts is reached
733        when max duration is reached
734D, [2021-07-20T14:59:49.400960 #49] DEBUG -- : 
735Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is not provided (default: false) when max duration is reached returns the value from the block
736          returns the value from the block
737D, [2021-07-20T14:59:49.401874 #49] DEBUG -- : 
738Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is false when retry_on_exception is not provided (default: false) when max duration is reached does not raise an exception
739          does not raise an exception
740    when raise_on_failure is not provided (default: true)
741      when retry_on_exception is true
742        when max duration is reached
743D, [2021-07-20T14:59:49.403239 #49] DEBUG -- : 
744Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is true when max duration is reached raises an exception
745          raises an exception
746D, [2021-07-20T14:59:49.404311 #49] DEBUG -- : 
747Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is true when max duration is reached does not raise an exception until max_duration is reached
748          does not raise an exception until max_duration is reached
749        when both max_attempts and max_duration are provided
750          when max_duration is reached first
751D, [2021-07-20T14:59:49.405649 #49] DEBUG -- : 
752Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is true when both max_attempts and max_duration are provided when max_duration is reached first raises an exception
753D, [2021-07-20T14:59:49.405768 #49] DEBUG -- : Attempt number 1
754            raises an exception
755          when max_attempts is reached first
756D, [2021-07-20T14:59:49.406869 #49] DEBUG -- : 
757Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is true when both max_attempts and max_duration are provided when max_attempts is reached first raises an exception
758D, [2021-07-20T14:59:49.406955 #49] DEBUG -- : Attempt number 1
759            raises an exception
760        when max duration is not reached
761D, [2021-07-20T14:59:49.408040 #49] DEBUG -- : 
762Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is true when max duration is not reached returns value from block
763          returns value from block
764      when retry_on_exception is not provided (default: false)
765        when max_duration is provided
766          when max duration is reached
767D, [2021-07-20T14:59:49.409459 #49] DEBUG -- : 
768Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is not provided (default: false) when max_duration is provided when max duration is reached ignores attempts
769            ignores attempts
770D, [2021-07-20T14:59:49.410403 #49] DEBUG -- : 
771Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is not provided (default: false) when max_duration is provided when max duration is reached raises an exception
772            raises an exception
773          when max duration is not reached
774D, [2021-07-20T14:59:49.411495 #49] DEBUG -- : 
775Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is not provided (default: false) when max_duration is provided when max duration is not reached returns value from block
776            returns value from block
777        when max_attempts is provided
778          when max_attempts is reached
779D, [2021-07-20T14:59:49.412687 #49] DEBUG -- : 
780Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is not provided (default: false) when max_attempts is provided when max_attempts is reached ignores duration
781D, [2021-07-20T14:59:49.412788 #49] DEBUG -- : Attempt number 1
782D, [2022-07-20T14:59:49.412874 #49] DEBUG -- : Attempt number 2
783            ignores duration
784D, [2021-07-20T14:59:49.414069 #49] DEBUG -- : 
785Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is not provided (default: false) when max_attempts is provided when max_attempts is reached raises an exception
786D, [2021-07-20T14:59:49.414160 #49] DEBUG -- : Attempt number 1
787            raises an exception
788          when max_attempts is not reached
789D, [2021-07-20T14:59:49.415149 #49] DEBUG -- : 
790Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is not provided (default: false) when max_attempts is provided when max_attempts is not reached returns value from block
791D, [2021-07-20T14:59:49.415219 #49] DEBUG -- : Attempt number 1
792            returns value from block
793        when both max_attempts and max_duration are provided
794          when max_attempts is reached first
795D, [2021-07-20T14:59:49.416392 #49] DEBUG -- : 
796Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is not provided (default: false) when both max_attempts and max_duration are provided when max_attempts is reached first raises an exception
797D, [2021-07-20T14:59:49.416480 #49] DEBUG -- : Attempt number 1
798            raises an exception
799          when max_duration is reached first
800D, [2021-07-20T14:59:49.417609 #49] DEBUG -- : 
801Starting test: QA::Support::Repeater.repeat_until when raise_on_failure is not provided (default: true) when retry_on_exception is not provided (default: false) when both max_attempts and max_duration are provided when max_duration is reached first raises an exception
802D, [2021-07-20T14:59:49.417711 #49] DEBUG -- : Attempt number 1
803            raises an exception
804QA::Scenario::Test::Integration::Kubernetes
805  #perform
806    behaves like a QA scenario class
807D, [2021-07-20T14:59:49.424162 #49] DEBUG -- : 
808Starting test: QA::Scenario::Test::Integration::Kubernetes#perform behaves like a QA scenario class performs before hooks only once
809      performs before hooks only once
810D, [2021-07-20T14:59:49.425958 #49] DEBUG -- : 
811Starting test: QA::Scenario::Test::Integration::Kubernetes#perform behaves like a QA scenario class sets tags on runner
812      sets tags on runner
813D, [2021-07-20T14:59:49.427391 #49] DEBUG -- : 
814Starting test: QA::Scenario::Test::Integration::Kubernetes#perform behaves like a QA scenario class responds to perform
815      responds to perform
816D, [2021-07-20T14:59:49.428660 #49] DEBUG -- : 
817Starting test: QA::Scenario::Test::Integration::Kubernetes#perform behaves like a QA scenario class sets an address of the subject
818      sets an address of the subject
819      with named command-line options
820D, [2021-07-20T14:59:49.430267 #49] DEBUG -- : 
821Starting test: QA::Scenario::Test::Integration::Kubernetes#perform behaves like a QA scenario class with named command-line options raises an error if the option is invalid
822        raises an error if the option is invalid
823D, [2021-07-20T14:59:49.432098 #49] DEBUG -- : 
824Starting test: QA::Scenario::Test::Integration::Kubernetes#perform behaves like a QA scenario class with named command-line options converts options to attributes
825        converts options to attributes
826D, [2021-07-20T14:59:49.433873 #49] DEBUG -- : 
827Starting test: QA::Scenario::Test::Integration::Kubernetes#perform behaves like a QA scenario class with named command-line options passes on options after --
828        passes on options after --
829      specifying RSpec options
830D, [2021-07-20T14:59:49.435696 #49] DEBUG -- : 
831Starting test: QA::Scenario::Test::Integration::Kubernetes#perform behaves like a QA scenario class specifying RSpec options sets options on runner
832        sets options on runner
833QA::Scenario::Template
834D, [2021-07-20T14:59:49.441292 #49] DEBUG -- : 
835Starting test: QA::Scenario::Template ensures an enabled feature is disabled afterwards
836  ensures an enabled feature is disabled afterwards
837D, [2021-07-20T14:59:49.443039 #49] DEBUG -- : 
838Starting test: QA::Scenario::Template allows a feature to be disabled
839  allows a feature to be disabled
840D, [2021-07-20T14:59:49.444441 #49] DEBUG -- : 
841Starting test: QA::Scenario::Template does not disable a feature if already disabled
842  does not disable a feature if already disabled
843D, [2021-07-20T14:59:49.445868 #49] DEBUG -- : 
844Starting test: QA::Scenario::Template allows a feature to be enabled
845  allows a feature to be enabled
846D, [2021-07-20T14:59:49.447155 #49] DEBUG -- : 
847Starting test: QA::Scenario::Template ensures a disabled feature is not enabled afterwards if it was disabled earlier
848  ensures a disabled feature is not enabled afterwards if it was disabled earlier
849D, [2021-07-20T14:59:49.448615 #49] DEBUG -- : 
850Starting test: QA::Scenario::Template ensures a disabled feature is enabled afterwards
851  ensures a disabled feature is enabled afterwards
852D, [2021-07-20T14:59:49.450097 #49] DEBUG -- : 
853Starting test: QA::Scenario::Template defines an about address by default
854  defines an about address by default
855QA::Scenario::Test::Integration::LDAPTLS
856  #perform
857    behaves like a QA scenario class
858D, [2021-07-20T14:59:49.456542 #49] DEBUG -- : 
859Starting test: QA::Scenario::Test::Integration::LDAPTLS#perform behaves like a QA scenario class performs before hooks only once
860      performs before hooks only once
861D, [2021-07-20T14:59:49.458799 #49] DEBUG -- : 
862Starting test: QA::Scenario::Test::Integration::LDAPTLS#perform behaves like a QA scenario class sets an address of the subject
863      sets an address of the subject
864D, [2021-07-20T14:59:49.460833 #49] DEBUG -- : 
865Starting test: QA::Scenario::Test::Integration::LDAPTLS#perform behaves like a QA scenario class sets tags on runner
866      sets tags on runner
867D, [2021-07-20T14:59:49.463306 #49] DEBUG -- : 
868Starting test: QA::Scenario::Test::Integration::LDAPTLS#perform behaves like a QA scenario class responds to perform
869      responds to perform
870      specifying RSpec options
871D, [2021-07-20T14:59:49.465986 #49] DEBUG -- : 
872Starting test: QA::Scenario::Test::Integration::LDAPTLS#perform behaves like a QA scenario class specifying RSpec options sets options on runner
873        sets options on runner
874      with named command-line options
875D, [2021-07-20T14:59:49.468873 #49] DEBUG -- : 
876Starting test: QA::Scenario::Test::Integration::LDAPTLS#perform behaves like a QA scenario class with named command-line options passes on options after --
877        passes on options after --
878D, [2021-07-20T14:59:49.471435 #49] DEBUG -- : 
879Starting test: QA::Scenario::Test::Integration::LDAPTLS#perform behaves like a QA scenario class with named command-line options converts options to attributes
880        converts options to attributes
881D, [2021-07-20T14:59:49.473826 #49] DEBUG -- : 
882Starting test: QA::Scenario::Test::Integration::LDAPTLS#perform behaves like a QA scenario class with named command-line options raises an error if the option is invalid
883        raises an error if the option is invalid
884QA::Support::Waiter
885  .wait_until
886D, [2021-07-20T14:59:49.480966 #49] DEBUG -- : 
887Starting test: QA::Support::Waiter.wait_until sets sleep_interval to 0.1 by default
888D, [2021-07-20T14:59:49.481611 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 0.1; raise_on_failure: true 
889D, [2021-07-20T14:59:49.481869 #49] DEBUG -- : ended wait_until
890    sets sleep_interval to 0.1 by default
891D, [2021-07-20T14:59:49.483065 #49] DEBUG -- : 
892Starting test: QA::Support::Waiter.wait_until sets raise_on_failure to true by default
893D, [2021-07-20T14:59:49.483443 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 0.1; raise_on_failure: true 
894D, [2021-07-20T14:59:49.483572 #49] DEBUG -- : ended wait_until
895    sets raise_on_failure to true by default
896D, [2021-07-20T14:59:49.484577 #49] DEBUG -- : 
897Starting test: QA::Support::Waiter.wait_until sets retry_on_exception to false by default
898D, [2021-07-20T14:59:49.484954 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 0.1; raise_on_failure: true 
899D, [2021-07-20T14:59:49.485078 #49] DEBUG -- : ended wait_until
900    sets retry_on_exception to false by default
901D, [2021-07-20T14:59:49.486053 #49] DEBUG -- : 
902Starting test: QA::Support::Waiter.wait_until allows logs to be silenced
903    allows logs to be silenced
904D, [2021-07-20T14:59:49.487451 #49] DEBUG -- : 
905Starting test: QA::Support::Waiter.wait_until sets max_duration to 60 by default
906D, [2021-07-20T14:59:49.487860 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 0.1; raise_on_failure: true 
907D, [2021-07-20T14:59:49.487993 #49] DEBUG -- : ended wait_until
908    sets max_duration to 60 by default
909    when the condition is true
910D, [2021-07-20T14:59:49.489125 #49] DEBUG -- : 
911Starting test: QA::Support::Waiter.wait_until when the condition is true logs the start
912      logs the start
913D, [2021-07-20T14:59:49.490526 #49] DEBUG -- : 
914Starting test: QA::Support::Waiter.wait_until when the condition is true logs the end
915      logs the end
916    when the condition is false
917D, [2021-07-20T14:59:49.492055 #49] DEBUG -- : 
918Starting test: QA::Support::Waiter.wait_until when the condition is false logs the end
919      logs the end
920D, [2021-07-20T14:59:49.493414 #49] DEBUG -- : 
921Starting test: QA::Support::Waiter.wait_until when the condition is false logs the start
922      logs the start
923QA::Scenario::Test::Instance::All
924  behaves like a QA scenario class
925D, [2021-07-20T14:59:49.499717 #49] DEBUG -- : 
926Starting test: QA::Scenario::Test::Instance::All behaves like a QA scenario class responds to perform
927    responds to perform
928D, [2021-07-20T14:59:49.501412 #49] DEBUG -- : 
929Starting test: QA::Scenario::Test::Instance::All behaves like a QA scenario class performs before hooks only once
930    performs before hooks only once
931D, [2021-07-20T14:59:49.503057 #49] DEBUG -- : 
932Starting test: QA::Scenario::Test::Instance::All behaves like a QA scenario class sets an address of the subject
933    sets an address of the subject
934D, [2021-07-20T14:59:49.504642 #49] DEBUG -- : 
935Starting test: QA::Scenario::Test::Instance::All behaves like a QA scenario class sets tags on runner
936    sets tags on runner
937    with named command-line options
938D, [2021-07-20T14:59:49.506436 #49] DEBUG -- : 
939Starting test: QA::Scenario::Test::Instance::All behaves like a QA scenario class with named command-line options raises an error if the option is invalid
940      raises an error if the option is invalid
941D, [2021-07-20T14:59:49.508315 #49] DEBUG -- : 
942Starting test: QA::Scenario::Test::Instance::All behaves like a QA scenario class with named command-line options converts options to attributes
943      converts options to attributes
944D, [2021-07-20T14:59:49.510031 #49] DEBUG -- : 
945Starting test: QA::Scenario::Test::Instance::All behaves like a QA scenario class with named command-line options passes on options after --
946      passes on options after --
947    specifying RSpec options
948D, [2021-07-20T14:59:49.511794 #49] DEBUG -- : 
949Starting test: QA::Scenario::Test::Instance::All behaves like a QA scenario class specifying RSpec options sets options on runner
950      sets options on runner
951QA::Scenario::Test::Integration::Github
952  #perform
953    behaves like a QA scenario class
954D, [2021-07-20T14:59:49.517525 #49] DEBUG -- : 
955Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class sets an address of the subject
956      sets an address of the subject
957D, [2021-07-20T14:59:49.519325 #49] DEBUG -- : 
958Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class requires a GitHub access token
959      requires a GitHub access token
960D, [2021-07-20T14:59:49.520894 #49] DEBUG -- : 
961Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class performs before hooks only once
962      performs before hooks only once
963D, [2021-07-20T14:59:49.522385 #49] DEBUG -- : 
964Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class responds to perform
965      responds to perform
966D, [2021-07-20T14:59:49.523741 #49] DEBUG -- : 
967Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class sets tags on runner
968      sets tags on runner
969      specifying RSpec options
970D, [2021-07-20T14:59:49.525434 #49] DEBUG -- : 
971Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class specifying RSpec options sets options on runner
972        sets options on runner
973      with named command-line options
974D, [2021-07-20T14:59:49.527079 #49] DEBUG -- : 
975Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class with named command-line options passes on options after --
976        passes on options after --
977D, [2021-07-20T14:59:49.528899 #49] DEBUG -- : 
978Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class with named command-line options raises an error if the option is invalid
979        raises an error if the option is invalid
980D, [2021-07-20T14:59:49.530652 #49] DEBUG -- : 
981Starting test: QA::Scenario::Test::Integration::Github#perform behaves like a QA scenario class with named command-line options converts options to attributes
982        converts options to attributes
983QA::EE::Scenario::Test::Integration::GroupSAML
984  #perform
985    behaves like a QA scenario class
986D, [2021-07-20T14:59:49.536677 #49] DEBUG -- : 
987Starting test: QA::EE::Scenario::Test::Integration::GroupSAML#perform behaves like a QA scenario class performs before hooks only once
988      performs before hooks only once
989D, [2021-07-20T14:59:49.538316 #49] DEBUG -- : 
990Starting test: QA::EE::Scenario::Test::Integration::GroupSAML#perform behaves like a QA scenario class sets tags on runner
991      sets tags on runner
992D, [2021-07-20T14:59:49.539888 #49] DEBUG -- : 
993Starting test: QA::EE::Scenario::Test::Integration::GroupSAML#perform behaves like a QA scenario class sets an address of the subject
994      sets an address of the subject
995D, [2021-07-20T14:59:49.541405 #49] DEBUG -- : 
996Starting test: QA::EE::Scenario::Test::Integration::GroupSAML#perform behaves like a QA scenario class responds to perform
997      responds to perform
998      with named command-line options
999D, [2021-07-20T14:59:49.542975 #49] DEBUG -- : 
1000Starting test: QA::EE::Scenario::Test::Integration::GroupSAML#perform behaves like a QA scenario class with named command-line options converts options to attributes
1001        converts options to attributes
1002D, [2021-07-20T14:59:49.544824 #49] DEBUG -- : 
1003Starting test: QA::EE::Scenario::Test::Integration::GroupSAML#perform behaves like a QA scenario class with named command-line options passes on options after --
1004        passes on options after --
1005D, [2021-07-20T14:59:49.546608 #49] DEBUG -- : 
1006Starting test: QA::EE::Scenario::Test::Integration::GroupSAML#perform behaves like a QA scenario class with named command-line options raises an error if the option is invalid
1007        raises an error if the option is invalid
1008      specifying RSpec options
1009D, [2021-07-20T14:59:49.548445 #49] DEBUG -- : 
1010Starting test: QA::EE::Scenario::Test::Integration::GroupSAML#perform behaves like a QA scenario class specifying RSpec options sets options on runner
1011        sets options on runner
1012QA::Service::DockerRun::GitlabRunner
1013D, [2021-07-20T14:59:49.559361 #49] DEBUG -- : 
1014Starting test: QA::Service::DockerRun::GitlabRunner defaults to run untagged
1015  defaults to run untagged
1016  #register!
1017    running untagged
1018D, [2021-07-20T14:59:49.560665 #49] DEBUG -- : 
1019Starting test: QA::Service::DockerRun::GitlabRunner#register! running untagged passes --run-untagged=true
1020      passes --run-untagged=true
1021D, [2021-07-20T14:59:49.561945 #49] DEBUG -- : 
1022Starting test: QA::Service::DockerRun::GitlabRunner#register! running untagged does not pass tag list
1023      does not pass tag list
1024    executors
1025D, [2021-07-20T14:59:49.563154 #49] DEBUG -- : 
1026Starting test: QA::Service::DockerRun::GitlabRunner#register! executors defaults to the shell executor
1027      defaults to the shell executor
1028      docker
1029D, [2021-07-20T14:59:49.564479 #49] DEBUG -- : 
1030Starting test: QA::Service::DockerRun::GitlabRunner#register! executors docker does not verify TLS
1031        does not verify TLS
1032D, [2021-07-20T14:59:49.565660 #49] DEBUG -- : 
1033Starting test: QA::Service::DockerRun::GitlabRunner#register! executors docker has a default image
1034        has a default image
1035D, [2021-07-20T14:59:49.566879 #49] DEBUG -- : 
1036Starting test: QA::Service::DockerRun::GitlabRunner#register! executors docker runs in privileged mode
1037        runs in privileged mode
1038D, [2021-07-20T14:59:49.568024 #49] DEBUG -- : 
1039Starting test: QA::Service::DockerRun::GitlabRunner#register! executors docker passes the host network
1040        passes the host network
1041D, [2021-07-20T14:59:49.569238 #49] DEBUG -- : 
1042Starting test: QA::Service::DockerRun::GitlabRunner#register! executors docker passes privileged mode
1043        passes privileged mode
1044D, [2021-07-20T14:59:49.570453 #49] DEBUG -- : 
1045Starting test: QA::Service::DockerRun::GitlabRunner#register! executors docker specifies the docker executor
1046        specifies the docker executor
1047D, [2021-07-20T14:59:49.571610 #49] DEBUG -- : 
1048Starting test: QA::Service::DockerRun::GitlabRunner#register! executors docker mounts the docker socket to the host runner
1049        mounts the docker socket to the host runner
1050    running tagged
1051      with only tags set
1052D, [2021-07-20T14:59:49.573149 #49] DEBUG -- : 
1053Starting test: QA::Service::DockerRun::GitlabRunner#register! running tagged with only tags set does not pass --run-untagged
1054        does not pass --run-untagged
1055D, [2021-07-20T14:59:49.574307 #49] DEBUG -- : 
1056Starting test: QA::Service::DockerRun::GitlabRunner#register! running tagged with only tags set passes the tags with comma-separation
1057        passes the tags with comma-separation
1058      with specifying only run_untagged
1059D, [2021-07-20T14:59:49.575582 #49] DEBUG -- : 
1060Starting test: QA::Service::DockerRun::GitlabRunner#register! running tagged with specifying only run_untagged raises an error if tags are not specified
1061        raises an error if tags are not specified
1062      when specifying contradicting variables
1063D, [2021-07-20T14:59:49.576782 #49] DEBUG -- : 
1064Starting test: QA::Service::DockerRun::GitlabRunner#register! running tagged when specifying contradicting variables raises an error
1065        raises an error
1066    defaults
1067D, [2021-07-20T14:59:49.578023 #49] DEBUG -- : 
1068Starting test: QA::Service::DockerRun::GitlabRunner#register! defaults runs untagged
1069      runs untagged
1070D, [2021-07-20T14:59:49.579137 #49] DEBUG -- : 
1071Starting test: QA::Service::DockerRun::GitlabRunner#register! defaults sets pertinent information
1072      sets pertinent information
1073D, [2021-07-20T14:59:49.580376 #49] DEBUG -- : 
1074Starting test: QA::Service::DockerRun::GitlabRunner#register! defaults cleans itself up
1075      cleans itself up
1076D, [2021-07-20T14:59:49.581486 #49] DEBUG -- : 
1077Starting test: QA::Service::DockerRun::GitlabRunner#register! defaults runs daemonized
1078      runs daemonized
1079D, [2021-07-20T14:59:49.582581 #49] DEBUG -- : 
1080Starting test: QA::Service::DockerRun::GitlabRunner#register! defaults runs non-interactively
1081      runs non-interactively
1082D, [2021-07-20T14:59:49.583711 #49] DEBUG -- : 
1083Starting test: QA::Service::DockerRun::GitlabRunner#register! defaults has no tags
1084      has no tags
1085  #tags=
1086D, [2021-07-20T14:59:49.584983 #49] DEBUG -- : 
1087Starting test: QA::Service::DockerRun::GitlabRunner#tags= sets run_untagged
1088    sets run_untagged
1089D, [2021-07-20T14:59:49.585854 #49] DEBUG -- : 
1090Starting test: QA::Service::DockerRun::GitlabRunner#tags= sets the tags
1091    sets the tags
1092QA::Runtime::Namespace
1093  .name
1094    when CACHE_NAMESPACE_NAME is defined
1095D, [2021-07-20T14:59:49.591367 #49] DEBUG -- : 
1096Starting test: QA::Runtime::Namespace.name when CACHE_NAMESPACE_NAME is defined caches name by default
1097      caches name by default
1098D, [2021-07-20T14:59:49.594062 #49] DEBUG -- : 
1099Starting test: QA::Runtime::Namespace.name when CACHE_NAMESPACE_NAME is defined caches name when reset_cache is false
1100      caches name when reset_cache is false
1101D, [2021-07-20T14:59:49.596459 #49] DEBUG -- : 
1102Starting test: QA::Runtime::Namespace.name when CACHE_NAMESPACE_NAME is defined does not cache name when reset_cache is true
1103      does not cache name when reset_cache is true
1104    when CACHE_NAMESPACE_NAME is not defined
1105D, [2021-07-20T14:59:49.599168 #49] DEBUG -- : 
1106Starting test: QA::Runtime::Namespace.name when CACHE_NAMESPACE_NAME is not defined does not cache name when reset_cache is true
1107      does not cache name when reset_cache is true
1108D, [2021-07-20T14:59:49.601554 #49] DEBUG -- : 
1109Starting test: QA::Runtime::Namespace.name when CACHE_NAMESPACE_NAME is not defined caches name by default
1110      caches name by default
1111  .path
1112D, [2021-07-20T14:59:49.604278 #49] DEBUG -- : 
1113Starting test: QA::Runtime::Namespace.path is always cached
1114    is always cached
1115QA::Scenario::Actable
1116  .perform
1117D, [2021-07-20T14:59:49.610157 #49] DEBUG -- : 
1118Starting test: QA::Scenario::Actable.perform makes it possible to pass binding
1119    makes it possible to pass binding
1120  .act
1121D, [2021-07-20T14:59:49.611622 #49] DEBUG -- : 
1122Starting test: QA::Scenario::Actable.act provides means to run steps
1123    provides means to run steps
1124D, [2021-07-20T14:59:49.612688 #49] DEBUG -- : 
1125Starting test: QA::Scenario::Actable.act supports passing variables
1126    supports passing variables
1127D, [2021-07-20T14:59:49.613646 #49] DEBUG -- : 
1128Starting test: QA::Scenario::Actable.act returns value from the last method
1129    returns value from the last method
1130QA::Support::Page::Logging
1131D, [2021-07-20T14:59:49.618796 #49] DEBUG -- : 
1132Starting test: QA::Support::Page::Logging logs scroll_to
1133  logs scroll_to
1134D, [2021-07-20T14:59:49.621071 #49] DEBUG -- : 
1135Starting test: QA::Support::Page::Logging logs find_element with class
1136  logs find_element with class
1137D, [2021-07-20T14:59:49.623071 #49] DEBUG -- : 
1138Starting test: QA::Support::Page::Logging logs refresh
1139  logs refresh
1140D, [2021-07-20T14:59:49.624998 #49] DEBUG -- : 
1141Starting test: QA::Support::Page::Logging logs has_no_element?
1142  logs has_no_element?
1143D, [2021-07-20T14:59:49.627043 #49] DEBUG -- : 
1144Starting test: QA::Support::Page::Logging logs asset_exists?
1145  logs asset_exists?
1146D, [2021-07-20T14:59:49.628855 #49] DEBUG -- : 
1147Starting test: QA::Support::Page::Logging logs within_element
1148  logs within_element
1149D, [2021-07-20T14:59:49.631411 #49] DEBUG -- : 
1150Starting test: QA::Support::Page::Logging logs has_no_element? with text
1151  logs has_no_element? with text
1152D, [2021-07-20T14:59:49.633582 #49] DEBUG -- : 
1153Starting test: QA::Support::Page::Logging logs find_element
1154  logs find_element
1155D, [2021-07-20T14:59:49.636023 #49] DEBUG -- : 
1156Starting test: QA::Support::Page::Logging logs find_element with wait
1157  logs find_element with wait
1158D, [2021-07-20T14:59:49.637994 #49] DEBUG -- : 
1159Starting test: QA::Support::Page::Logging logs find_element with text
1160  logs find_element with text
1161D, [2021-07-20T14:59:49.640433 #49] DEBUG -- : 
1162Starting test: QA::Support::Page::Logging logs fill_element
1163  logs fill_element
1164D, [2021-07-20T14:59:49.642413 #49] DEBUG -- : 
1165Starting test: QA::Support::Page::Logging logs click_element
1166  logs click_element
1167D, [2021-07-20T14:59:49.644420 #49] DEBUG -- : 
1168Starting test: QA::Support::Page::Logging logs has_element?
1169  logs has_element?
1170D, [2021-07-20T14:59:49.646152 #49] DEBUG -- : 
1171Starting test: QA::Support::Page::Logging logs has_text?
1172  logs has_text?
1173D, [2021-07-20T14:59:49.648170 #49] DEBUG -- : 
1174Starting test: QA::Support::Page::Logging logs finished_loading?
1175  logs finished_loading?
1176D, [2021-07-20T14:59:49.650188 #49] DEBUG -- : 
1177Starting test: QA::Support::Page::Logging logs has_no_text?
1178  logs has_no_text?
1179D, [2021-07-20T14:59:49.652117 #49] DEBUG -- : 
1180Starting test: QA::Support::Page::Logging logs has_element? with text
1181  logs has_element? with text
1182  all_elements
1183D, [2021-07-20T14:59:49.653962 #49] DEBUG -- : 
1184Starting test: QA::Support::Page::Logging all_elements logs 0 if no elements are found
1185    logs 0 if no elements are found
1186D, [2021-07-20T14:59:49.656483 #49] DEBUG -- : 
1187Starting test: QA::Support::Page::Logging all_elements logs the number of elements found
1188    logs the number of elements found
1189QA::Support::Run
1190D, [2021-07-20T14:59:49.662940 #49] DEBUG -- : 
1191Starting test: QA::Support::Run retries twice and succeeds the third time
1192D, [2021-07-20T14:59:49.663484 #49] DEBUG -- : Attempt number 1
1193D, [2021-07-20T14:59:49.663537 #49] DEBUG -- : pwd=[/builds/gitlab-org/gitlab/qa], command=[some command 2>&1]
1194D, [2021-07-20T14:59:49.663676 #49] DEBUG -- : output=[successful response], exitstatus=[0]
1195  retries twice and succeeds the third time
1196D, [2021-07-20T14:59:49.664736 #49] DEBUG -- : 
1197Starting test: QA::Support::Run runs successfully
1198D, [2021-07-20T14:59:49.665068 #49] DEBUG -- : Attempt number 1
1199D, [2021-07-20T14:59:49.665125 #49] DEBUG -- : pwd=[/builds/gitlab-org/gitlab/qa], command=[some command 2>&1]
1200D, [2021-07-20T14:59:49.665276 #49] DEBUG -- : output=[successful response], exitstatus=[0]
1201  runs successfully
1202D, [2021-07-20T14:59:49.666252 #49] DEBUG -- : 
1203Starting test: QA::Support::Run raises an exception on 3rd failure
1204D, [2021-07-20T14:59:49.666571 #49] DEBUG -- : Attempt number 1
1205D, [2021-07-20T14:59:49.666628 #49] DEBUG -- : pwd=[/builds/gitlab-org/gitlab/qa], command=[some command 2>&1]
1206D, [2021-07-20T14:59:49.666732 #49] DEBUG -- : output=[FAILURE], exitstatus=[1]
1207  raises an exception on 3rd failure
1208QA::Resource::SSHKey
1209  #key
1210D, [2021-07-20T14:59:49.671542 #49] DEBUG -- : 
1211Starting test: QA::Resource::SSHKey#key generates a default key
1212Executing `["ssh-keygen", "-t", "rsa", "-b", "4096", "-f", "/tmp/d20210720-49-1h62fao/id_rsa", "-N", ""]`
1213Generating public/private rsa key pair.
1214Your identification has been saved in /tmp/d20210720-49-1h62fao/id_rsa.
1215Your public key has been saved in /tmp/d20210720-49-1h62fao/id_rsa.pub.
1216The key fingerprint is:
1217SHA256:KNJhkDoidiPF9L6SPq+hVn2XzD1g1GbvTmD4idxV3wU root@runner-8a6210b8-project-278964-concurrent-0
1218The key's randomart image is:
1219+---[RSA 4096]----+
1220|  +o      .   E. |
1221|  .+.    . +   ..|
1222| .. o.  . + . . +|
1223|=o =.. . + o o  o|
1224|+.+ =.. S O =    |
1225|   o.o.. B * o   |
1226|  .+ .. .   +    |
1227| .o.o        .   |
1228|.. o+.           |
1229+----[SHA256]-----+
1230    generates a default key
1231  #title
1232D, [2021-07-20T14:59:49.847334 #49] DEBUG -- : 
1233Starting test: QA::Resource::SSHKey#title generates a default title
1234    generates a default title
1235D, [2021-07-20T14:59:49.848456 #49] DEBUG -- : 
1236Starting test: QA::Resource::SSHKey#title is possible to set the title
1237    is possible to set the title
1238QA::Support::Retrier
1239  .retry_until
1240D, [2021-07-20T14:59:49.853464 #49] DEBUG -- : 
1241Starting test: QA::Support::Retrier.retry_until sets retry_on_exception to false by default
1242D, [2021-07-20T14:59:49.853999 #49] DEBUG -- : with retry_until: max_attempts: 3; reload_page: ; sleep_interval: 0; raise_on_failure: true; retry_on_exception: false
1243D, [2021-07-20T14:59:49.854150 #49] DEBUG -- : ended retry_until
1244    sets retry_on_exception to false by default
1245D, [2021-07-20T14:59:49.855180 #49] DEBUG -- : 
1246Starting test: QA::Support::Retrier.retry_until sets sleep_interval to 0 by default
1247D, [2021-07-20T14:59:49.855476 #49] DEBUG -- : with retry_until: max_attempts: 3; reload_page: ; sleep_interval: 0; raise_on_failure: true; retry_on_exception: false
1248D, [2021-07-20T14:59:49.855588 #49] DEBUG -- : ended retry_until
1249    sets sleep_interval to 0 by default
1250D, [2021-07-20T14:59:49.856522 #49] DEBUG -- : 
1251Starting test: QA::Support::Retrier.retry_until sets raise_on_failure to true by default
1252D, [2021-07-20T14:59:49.856870 #49] DEBUG -- : with retry_until: max_attempts: 3; reload_page: ; sleep_interval: 0; raise_on_failure: true; retry_on_exception: false
1253D, [2021-07-20T14:59:49.856974 #49] DEBUG -- : ended retry_until
1254    sets raise_on_failure to true by default
1255    when the condition is false
1256D, [2021-07-20T14:59:49.858193 #49] DEBUG -- : 
1257Starting test: QA::Support::Retrier.retry_until when the condition is false logs the end
1258      logs the end
1259D, [2021-07-20T14:59:49.859561 #49] DEBUG -- : 
1260Starting test: QA::Support::Retrier.retry_until when the condition is false logs the start
1261      logs the start
1262    when max_duration and max_attempts are nil
1263D, [2021-07-20T14:59:49.861018 #49] DEBUG -- : 
1264Starting test: QA::Support::Retrier.retry_until when max_duration and max_attempts are nil sets max attempts to 3 by default
1265D, [2021-07-20T14:59:49.861317 #49] DEBUG -- : with retry_until: max_attempts: 3; reload_page: ; sleep_interval: 0; raise_on_failure: true; retry_on_exception: false
1266D, [2021-07-20T14:59:49.861423 #49] DEBUG -- : ended retry_until
1267      sets max attempts to 3 by default
1268    when the condition is true
1269D, [2021-07-20T14:59:49.862568 #49] DEBUG -- : 
1270Starting test: QA::Support::Retrier.retry_until when the condition is true logs max duration
1271      logs max duration
1272D, [2021-07-20T14:59:49.863895 #49] DEBUG -- : 
1273Starting test: QA::Support::Retrier.retry_until when the condition is true logs the end
1274      logs the end
1275D, [2021-07-20T14:59:49.865184 #49] DEBUG -- : 
1276Starting test: QA::Support::Retrier.retry_until when the condition is true logs max attempts (3 by default)
1277      logs max attempts (3 by default)
1278  .retry_on_exception
1279D, [2021-07-20T14:59:49.866769 #49] DEBUG -- : 
1280Starting test: QA::Support::Retrier.retry_on_exception sets max_attempts to 3 by default
1281D, [2021-07-20T14:59:49.867090 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 0.5 
1282D, [2021-07-20T14:59:49.867209 #49] DEBUG -- : ended retry_on_exception
1283    sets max_attempts to 3 by default
1284D, [2021-07-20T14:59:49.868172 #49] DEBUG -- : 
1285Starting test: QA::Support::Retrier.retry_on_exception sets sleep_interval to 0.5 by default
1286D, [2021-07-20T14:59:49.868502 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 0.5 
1287D, [2021-07-20T14:59:49.868616 #49] DEBUG -- : ended retry_on_exception
1288    sets sleep_interval to 0.5 by default
1289D, [2021-07-20T14:59:49.869547 #49] DEBUG -- : 
1290Starting test: QA::Support::Retrier.retry_on_exception sets retry_on_exception to true
1291D, [2021-07-20T14:59:49.869898 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 0.5 
1292D, [2021-07-20T14:59:49.870056 #49] DEBUG -- : ended retry_on_exception
1293    sets retry_on_exception to true
1294D, [2021-07-20T14:59:49.871039 #49] DEBUG -- : 
1295Starting test: QA::Support::Retrier.retry_on_exception does not repeat if no exception is raised
1296D, [2021-07-20T14:59:49.871133 #49] DEBUG -- : with retry_on_exception: max_attempts: 2; reload_page: ; sleep_interval: 0.5 
1297D, [2021-07-20T14:59:49.871324 #49] DEBUG -- : Attempt number 1
1298D, [2021-07-20T14:59:49.871356 #49] DEBUG -- : ended retry_on_exception
1299    does not repeat if no exception is raised
1300    when the condition is false
1301D, [2021-07-20T14:59:49.872772 #49] DEBUG -- : 
1302Starting test: QA::Support::Retrier.retry_on_exception when the condition is false logs the start
1303      logs the start
1304D, [2021-07-20T14:59:49.874215 #49] DEBUG -- : 
1305Starting test: QA::Support::Retrier.retry_on_exception when the condition is false logs the end
1306      logs the end
1307    when the condition is true
1308D, [2021-07-20T14:59:49.875823 #49] DEBUG -- : 
1309Starting test: QA::Support::Retrier.retry_on_exception when the condition is true logs the end
1310      logs the end
1311D, [2021-07-20T14:59:49.877226 #49] DEBUG -- : 
1312Starting test: QA::Support::Retrier.retry_on_exception when the condition is true logs max_attempts, reload_page, and sleep_interval parameters
1313      logs max_attempts, reload_page, and sleep_interval parameters
1314QA::Runtime::ApplicationSettings
1315  .set_application_settings
1316D, [2021-07-20T14:59:49.882819 #49] DEBUG -- : 
1317Starting test: QA::Runtime::ApplicationSettings.set_application_settings sets application settings
1318I, [2021-07-20T14:59:49.883945 #49]  INFO -- : Setting application settings: {:allow_local_requests_from_web_hooks_and_services=>true}
1319    sets application settings
1320  .get_application_settings
1321D, [2021-07-20T14:59:49.885493 #49] DEBUG -- : 
1322Starting test: QA::Runtime::ApplicationSettings.get_application_settings gets application settings
1323    gets application settings
1324QA::Runtime::Logger
1325D, [2021-07-20T14:59:49.891161 #49] DEBUG -- : 
1326Starting test: QA::Runtime::Logger logs unknown
1327  logs unknown
1328D, [2021-07-20T14:59:49.892630 #49] DEBUG -- : 
1329Starting test: QA::Runtime::Logger logs info
1330  logs info
1331D, [2021-07-20T14:59:49.894023 #49] DEBUG -- : 
1332Starting test: QA::Runtime::Logger logs fatal
1333  logs fatal
1334D, [2021-07-20T14:59:49.895325 #49] DEBUG -- : 
1335Starting test: QA::Runtime::Logger logs error
1336  logs error
1337D, [2021-07-20T14:59:49.896672 #49] DEBUG -- : 
1338Starting test: QA::Runtime::Logger logs warn
1339  logs warn
1340D, [2021-07-20T14:59:49.898025 #49] DEBUG -- : 
1341Starting test: QA::Runtime::Logger logs debug
1342  logs debug
1343QA::Runtime::Env
1344  .github_access_token
1345D, [2021-07-20T14:59:49.903512 #49] DEBUG -- : 
1346Starting test: QA::Runtime::Env.github_access_token returns "" if GITHUB_ACCESS_TOKEN is not defined
1347    returns "" if GITHUB_ACCESS_TOKEN is not defined
1348D, [2021-07-20T14:59:49.906070 #49] DEBUG -- : 
1349Starting test: QA::Runtime::Env.github_access_token returns stripped string if GITHUB_ACCESS_TOKEN is defined
1350    returns stripped string if GITHUB_ACCESS_TOKEN is defined
1351  .debug?
1352    behaves like boolean method
1353      behaves like boolean method with parameter
1354        when there is no env variable set
1355D, [2021-07-20T14:59:49.909339 #49] DEBUG -- : 
1356Starting test: QA::Runtime::Env.debug? behaves like boolean method behaves like boolean method with parameter when there is no env variable set returns the default, false
1357          returns the default, false
1358        when there is an env variable set
1359D, [2021-07-20T14:59:49.912047 #49] DEBUG -- : 
1360Starting test: QA::Runtime::Env.debug? behaves like boolean method behaves like boolean method with parameter when there is an env variable set returns true when anything else specified
1361          returns true when anything else specified
1362D, [2021-07-20T14:59:49.915211 #49] DEBUG -- : 
1363Starting test: QA::Runtime::Env.debug? behaves like boolean method behaves like boolean method with parameter when there is an env variable set returns false when falsey values specified
1364          returns false when falsey values specified
1365  .personal_access_token=
1366D, [2021-07-20T14:59:49.918587 #49] DEBUG -- : 
1367Starting test: QA::Runtime::Env.personal_access_token= saves the token
1368    saves the token
1369  .signup_disabled?
1370    behaves like boolean method
1371      behaves like boolean method with parameter
1372        when there is no env variable set
1373D, [2021-07-20T14:59:49.920526 #49] DEBUG -- : 
1374Starting test: QA::Runtime::Env.signup_disabled? behaves like boolean method behaves like boolean method with parameter when there is no env variable set returns the default, false
1375          returns the default, false
1376        when there is an env variable set
1377D, [2021-07-20T14:59:49.923059 #49] DEBUG -- : 
1378Starting test: QA::Runtime::Env.signup_disabled? behaves like boolean method behaves like boolean method with parameter when there is an env variable set returns false when falsey values specified
1379          returns false when falsey values specified
1380D, [2021-07-20T14:59:49.926173 #49] DEBUG -- : 
1381Starting test: QA::Runtime::Env.signup_disabled? behaves like boolean method behaves like boolean method with parameter when there is an env variable set returns true when anything else specified
1382          returns true when anything else specified
1383  .remote_grid_protocol
1384D, [2021-07-20T14:59:49.929890 #49] DEBUG -- : 
1385Starting test: QA::Runtime::Env.remote_grid_protocol defaults protocol to http
1386    defaults protocol to http
1387  .can_test?
1388D, [2021-07-20T14:59:49.932601 #49] DEBUG -- : 
1389Starting test: QA::Runtime::Env.can_test? raises ArgumentError if feature is unknown
1390    raises ArgumentError if feature is unknown
1391    behaves like boolean method with parameter
1392      when there is an env variable set
1393D, [2021-07-20T14:59:49.934384 #49] DEBUG -- : 
1394Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is an env variable set returns false when falsey values specified
1395        returns false when falsey values specified
1396D, [2021-07-20T14:59:49.937912 #49] DEBUG -- : 
1397Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is an env variable set returns true when anything else specified
1398        returns true when anything else specified
1399      when there is no env variable set
1400D, [2021-07-20T14:59:49.941451 #49] DEBUG -- : 
1401Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is no env variable set returns the default, true
1402        returns the default, true
1403    behaves like boolean method with parameter
1404      when there is an env variable set
1405D, [2021-07-20T14:59:49.944563 #49] DEBUG -- : 
1406Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is an env variable set returns false when falsey values specified
1407        returns false when falsey values specified
1408D, [2021-07-20T14:59:49.948338 #49] DEBUG -- : 
1409Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is an env variable set returns true when anything else specified
1410        returns true when anything else specified
1411      when there is no env variable set
1412D, [2021-07-20T14:59:49.952800 #49] DEBUG -- : 
1413Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is no env variable set returns the default, true
1414        returns the default, true
1415    behaves like boolean method with parameter
1416      when there is an env variable set
1417D, [2021-07-20T14:59:49.956104 #49] DEBUG -- : 
1418Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is an env variable set returns false when falsey values specified
1419        returns false when falsey values specified
1420D, [2021-07-20T14:59:49.959599 #49] DEBUG -- : 
1421Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is an env variable set returns true when anything else specified
1422        returns true when anything else specified
1423      when there is no env variable set
1424D, [2021-07-20T14:59:49.963176 #49] DEBUG -- : 
1425Starting test: QA::Runtime::Env.can_test? behaves like boolean method with parameter when there is no env variable set returns the default, true
1426        returns the default, true
1427  .webdriver_headless?
1428    behaves like boolean method
1429      behaves like boolean method with parameter
1430        when there is an env variable set
1431D, [2021-07-20T14:59:49.970568 #49] DEBUG -- : 
1432Starting test: QA::Runtime::Env.webdriver_headless? behaves like boolean method behaves like boolean method with parameter when there is an env variable set returns false when falsey values specified
1433          returns false when falsey values specified
1434D, [2021-07-20T14:59:49.973992 #49] DEBUG -- : 
1435Starting test: QA::Runtime::Env.webdriver_headless? behaves like boolean method behaves like boolean method with parameter when there is an env variable set returns true when anything else specified
1436          returns true when anything else specified
1437        when there is no env variable set
1438D, [2021-07-20T14:59:49.977269 #49] DEBUG -- : 
1439Starting test: QA::Runtime::Env.webdriver_headless? behaves like boolean method behaves like boolean method with parameter when there is no env variable set returns the default, true
1440          returns the default, true
1441  .require_github_access_token!
1442D, [2021-07-20T14:59:49.979825 #49] DEBUG -- : 
1443Starting test: QA::Runtime::Env.require_github_access_token! raises ArgumentError if GITHUB_ACCESS_TOKEN is not defined
1444    raises ArgumentError if GITHUB_ACCESS_TOKEN is not defined
1445D, [2021-07-20T14:59:49.982056 #49] DEBUG -- : 
1446Starting test: QA::Runtime::Env.require_github_access_token! does not raise if GITHUB_ACCESS_TOKEN is defined
1447    does not raise if GITHUB_ACCESS_TOKEN is defined
1448  .require_admin_access_token!
1449D, [2021-07-20T14:59:49.984444 #49] DEBUG -- : 
1450Starting test: QA::Runtime::Env.require_admin_access_token! raises ArgumentError if GITLAB_QA_ADMIN_ACCESS_TOKEN is not specified
1451    raises ArgumentError if GITLAB_QA_ADMIN_ACCESS_TOKEN is not specified
1452D, [2021-07-20T14:59:49.986730 #49] DEBUG -- : 
1453Starting test: QA::Runtime::Env.require_admin_access_token! does not raise exception if GITLAB_QA_ADMIN_ACCESS_TOKEN is specified
1454    does not raise exception if GITLAB_QA_ADMIN_ACCESS_TOKEN is specified
1455  .knapsack?
1456D, [2021-07-20T14:59:49.989213 #49] DEBUG -- : 
1457Starting test: QA::Runtime::Env.knapsack? returns true if KNAPSACK_GENERATE_REPORT is defined
1458    returns true if KNAPSACK_GENERATE_REPORT is defined
1459D, [2021-07-20T14:59:49.991458 #49] DEBUG -- : 
1460Starting test: QA::Runtime::Env.knapsack? returns true if KNAPSACK_REPORT_PATH is defined
1461    returns true if KNAPSACK_REPORT_PATH is defined
1462D, [2021-07-20T14:59:49.993674 #49] DEBUG -- : 
1463Starting test: QA::Runtime::Env.knapsack? returns true if KNAPSACK_TEST_FILE_PATTERN is defined
1464    returns true if KNAPSACK_TEST_FILE_PATTERN is defined
1465D, [2021-07-20T14:59:49.995927 #49] DEBUG -- : 
1466Starting test: QA::Runtime::Env.knapsack? returns false if neither KNAPSACK_GENERATE_REPORT nor KNAPSACK_REPORT_PATH nor KNAPSACK_TEST_FILE_PATTERN are defined
1467    returns false if neither KNAPSACK_GENERATE_REPORT nor KNAPSACK_REPORT_PATH nor KNAPSACK_TEST_FILE_PATTERN are defined
1468  .log_destination
1469D, [2021-07-20T14:59:49.997030 #49] DEBUG -- : 
1470Starting test: QA::Runtime::Env.log_destination returns $stdout if QA_LOG_PATH is not defined
1471    returns $stdout if QA_LOG_PATH is not defined
1472D, [2021-07-20T14:59:49.999183 #49] DEBUG -- : 
1473Starting test: QA::Runtime::Env.log_destination returns the path if QA_LOG_PATH is defined
1474    returns the path if QA_LOG_PATH is defined
1475  .personal_access_token
1476    when GITLAB_QA_ACCESS_TOKEN is set
1477D, [2021-07-20T14:59:50.002409 #49] DEBUG -- : 
1478Starting test: QA::Runtime::Env.personal_access_token when GITLAB_QA_ACCESS_TOKEN is set returns specified token from env
1479      returns specified token from env
1480    when @personal_access_token is set
1481D, [2021-07-20T14:59:50.004341 #49] DEBUG -- : 
1482Starting test: QA::Runtime::Env.personal_access_token when @personal_access_token is set returns the instance variable value
1483      returns the instance variable value
1484  .remote_grid
1485D, [2021-07-20T14:59:50.005632 #49] DEBUG -- : 
1486Starting test: QA::Runtime::Env.remote_grid is falsey if QA_REMOTE_GRID is not set
1487    is falsey if QA_REMOTE_GRID is not set
1488D, [2021-07-20T14:59:50.006571 #49] DEBUG -- : 
1489Starting test: QA::Runtime::Env.remote_grid accepts https protocol
1490    accepts https protocol
1491    without credentials
1492D, [2021-07-20T14:59:50.008842 #49] DEBUG -- : 
1493Starting test: QA::Runtime::Env.remote_grid without credentials has a grid of http://grid/wd/hub
1494      has a grid of http://grid/wd/hub
1495    with credentials
1496D, [2021-07-20T14:59:50.010799 #49] DEBUG -- : 
1497Starting test: QA::Runtime::Env.remote_grid with credentials has a grid of http://user:key@grid/wd/hub
1498      has a grid of http://user:key@grid/wd/hub
1499  .running_in_ci?
1500    when there is an env variable set
1501D, [2021-07-20T14:59:50.013534 #49] DEBUG -- : 
1502Starting test: QA::Runtime::Env.running_in_ci? when there is an env variable set returns true if CI
1503      returns true if CI
1504D, [2021-07-20T14:59:50.015311 #49] DEBUG -- : 
1505Starting test: QA::Runtime::Env.running_in_ci? when there is an env variable set returns true if CI_SERVER
1506      returns true if CI_SERVER
1507    when there is no env variable set
1508D, [2021-07-20T14:59:50.017191 #49] DEBUG -- : 
1509Starting test: QA::Runtime::Env.running_in_ci? when there is no env variable set returns true
1510      returns true
1511  .knapsack?
1512D, [2021-07-20T14:59:50.019526 #49] DEBUG -- : 
1513Starting test: QA::Runtime::Env.knapsack? returns true if KNAPSACK_TEST_FILE_PATTERN is defined
1514    returns true if KNAPSACK_TEST_FILE_PATTERN is defined
1515D, [2021-07-20T14:59:50.021300 #49] DEBUG -- : 
1516Starting test: QA::Runtime::Env.knapsack? returns true if KNAPSACK_REPORT_PATH is defined
1517    returns true if KNAPSACK_REPORT_PATH is defined
1518D, [2021-07-20T14:59:50.023225 #49] DEBUG -- : 
1519Starting test: QA::Runtime::Env.knapsack? returns true if KNAPSACK_GENERATE_REPORT is defined
1520    returns true if KNAPSACK_GENERATE_REPORT is defined
1521D, [2021-07-20T14:59:50.025103 #49] DEBUG -- : 
1522Starting test: QA::Runtime::Env.knapsack? returns false if neither KNAPSACK_GENERATE_REPORT nor KNAPSACK_REPORT_PATH nor KNAPSACK_TEST_FILE_PATTERN are defined
1523    returns false if neither KNAPSACK_GENERATE_REPORT nor KNAPSACK_REPORT_PATH nor KNAPSACK_TEST_FILE_PATTERN are defined
1524  remote grid credentials
1525D, [2021-07-20T14:59:50.026254 #49] DEBUG -- : 
1526Starting test: QA::Runtime::Env remote grid credentials throws ArgumentError if GRID_ACCESS_KEY is not specified with USERNAME
1527    throws ArgumentError if GRID_ACCESS_KEY is not specified with USERNAME
1528D, [2021-07-20T14:59:50.028402 #49] DEBUG -- : 
1529Starting test: QA::Runtime::Env remote grid credentials returns a user:key@ combination when all args are satiated
1530    returns a user:key@ combination when all args are satiated
1531D, [2021-07-20T14:59:50.030679 #49] DEBUG -- : 
1532Starting test: QA::Runtime::Env remote grid credentials is blank if username is empty
1533    is blank if username is empty
1534  .forker?
1535D, [2021-07-20T14:59:50.032920 #49] DEBUG -- : 
1536Starting test: QA::Runtime::Env.forker? returns false if only forker username is defined
1537    returns false if only forker username is defined
1538D, [2021-07-20T14:59:50.035283 #49] DEBUG -- : 
1539Starting test: QA::Runtime::Env.forker? returns true if forker username and password are defined
1540    returns true if forker username and password are defined
1541D, [2021-07-20T14:59:50.037849 #49] DEBUG -- : 
1542Starting test: QA::Runtime::Env.forker? returns false if no forker credentials are defined
1543    returns false if no forker credentials are defined
1544D, [2021-07-20T14:59:50.039877 #49] DEBUG -- : 
1545Starting test: QA::Runtime::Env.forker? returns false if only forker password is defined
1546    returns false if only forker password is defined
1547QA::Runtime::Key::RSA
1548  #public_key
1549D, [2021-07-20T14:59:50.046221 #49] DEBUG -- : 
1550Starting test: QA::Runtime::Key::RSA#public_key generates a public RSA key
1551Executing `["ssh-keygen", "-t", "rsa", "-b", "4096", "-f", "/tmp/d20210720-49-wf5590/id_rsa", "-N", ""]`
1552Generating public/private rsa key pair.
1553Your identification has been saved in /tmp/d20210720-49-wf5590/id_rsa.
1554Your public key has been saved in /tmp/d20210720-49-wf5590/id_rsa.pub.
1555The key fingerprint is:
1556SHA256:uMkaoeOrUQEem11orqX8Jwqb3VsO4df52QtOFxtxtZs root@runner-8a6210b8-project-278964-concurrent-0
1557The key's randomart image is:
1558+---[RSA 4096]----+
1559|..  ..          .|
1560|..=o.          ..|
1561| ++.        . .. |
1562|   +   .     o  o|
1563|. = o . S   o  E |
1564| = o + + .   +   |
1565|o + + * o o o    |
1566|.* = O   + =     |
1567|+o=.*..   + o.   |
1568+----[SHA256]-----+
1569    generates a public RSA key
1570QA::Resource::ApiFabricator
1571  #fabricate_via_api!
1572    when resource does not support fabrication via the API
1573D, [2021-07-20T14:59:50.375040 #49] DEBUG -- : 
1574Starting test: QA::Resource::ApiFabricator#fabricate_via_api! when resource does not support fabrication via the API raises a NotImplementedError exception
1575      raises a NotImplementedError exception
1576    when resource supports fabrication via the API
1577      when creating a resource
1578D, [2021-07-20T14:59:50.377168 #49] DEBUG -- : 
1579Starting test: QA::Resource::ApiFabricator#fabricate_via_api! when resource supports fabrication via the API when creating a resource returns the resource URL
1580        returns the resource URL
1581D, [2021-07-20T14:59:50.379413 #49] DEBUG -- : 
1582Starting test: QA::Resource::ApiFabricator#fabricate_via_api! when resource supports fabrication via the API when creating a resource populates api_resource with the resource
1583        populates api_resource with the resource
1584        when the POST fails
1585D, [2021-07-20T14:59:50.381493 #49] DEBUG -- : 
1586Starting test: QA::Resource::ApiFabricator#fabricate_via_api! when resource supports fabrication via the API when creating a resource when the POST fails raises a ResourceFabricationFailedError exception
1587          raises a ResourceFabricationFailedError exception
1588      #transform_api_resource
1589D, [2021-07-20T14:59:50.384047 #49] DEBUG -- : 
1590Starting test: QA::Resource::ApiFabricator#fabricate_via_api! when resource supports fabrication via the API #transform_api_resource transforms the resource
1591        transforms the resource
1592  #api_support?
1593    when resource does not support fabrication via the API
1594D, [2021-07-20T14:59:50.386168 #49] DEBUG -- : 
1595Starting test: QA::Resource::ApiFabricator#api_support? when resource does not support fabrication via the API returns false
1596      returns false
1597    when resource supports fabrication via the API
1598D, [2021-07-20T14:59:50.387320 #49] DEBUG -- : 
1599Starting test: QA::Resource::ApiFabricator#api_support? when resource supports fabrication via the API returns false
1600      returns false
1601QA::Support::WaitForRequests
1602  .wait_for_requests
1603    when skip_finished_loading_check is defaulted to false
1604D, [2021-07-20T14:59:50.392814 #49] DEBUG -- : 
1605Starting test: QA::Support::WaitForRequests.wait_for_requests when skip_finished_loading_check is defaulted to false calls finished_loading?
1606      calls finished_loading?
1607    when skip_finished_loading_check is true
1608D, [2021-07-20T14:59:50.394441 #49] DEBUG -- : 
1609Starting test: QA::Support::WaitForRequests.wait_for_requests when skip_finished_loading_check is true does not call finished_loading?
1610      does not call finished_loading?
1611QA::Runtime::Feature
1612  feature_flag: :a_flag
1613    .enable
1614D, [2021-07-20T14:59:50.401377 #49] DEBUG -- : 
1615Starting test: QA::Runtime::Feature feature_flag: :a_flag .enable enables a feature flag
1616I, [2021-07-20T14:59:50.402357 #49]  INFO -- : Enabling feature: a_flag
1617D, [2021-07-20T14:59:50.402405 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1618D, [2021-07-20T14:59:50.402443 #49] DEBUG -- : Attempt number 1
1619D, [2021-07-20T14:59:50.402732 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1620D, [2021-07-20T14:59:50.402959 #49] DEBUG -- : ended wait_until
1621I, [2021-07-20T14:59:50.403044 #49]  INFO -- : Successfully enabled and verified feature flag: a_flag
1622D, [2021-07-20T14:59:50.403073 #49] DEBUG -- : ended retry_on_exception
1623      enables a feature flag
1624      when a project scope is provided
1625        behaves like enables a feature flag
1626D, [2021-07-20T14:59:50.404265 #49] DEBUG -- : 
1627Starting test: QA::Runtime::Feature feature_flag: :a_flag .enable when a project scope is provided behaves like enables a feature flag enables a feature flag for a scope
1628D, [2021-07-20T14:59:50.405245 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1629D, [2021-07-20T14:59:50.405288 #49] DEBUG -- : Attempt number 1
1630D, [2021-07-20T14:59:50.405481 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1631D, [2021-07-20T14:59:50.405689 #49] DEBUG -- : ended wait_until
1632D, [2021-07-20T14:59:50.405840 #49] DEBUG -- : ended retry_on_exception
1633          enables a feature flag for a scope
1634      when a feature group scope is provided
1635        behaves like enables a feature flag
1636D, [2021-07-20T14:59:50.407031 #49] DEBUG -- : 
1637Starting test: QA::Runtime::Feature feature_flag: :a_flag .enable when a feature group scope is provided behaves like enables a feature flag enables a feature flag for a scope
1638D, [2021-07-20T14:59:50.408042 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1639D, [2021-07-20T14:59:50.408102 #49] DEBUG -- : Attempt number 1
1640D, [2021-07-20T14:59:50.408315 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1641D, [2021-07-20T14:59:50.408642 #49] DEBUG -- : ended wait_until
1642D, [2021-07-20T14:59:50.408723 #49] DEBUG -- : ended retry_on_exception
1643          enables a feature flag for a scope
1644      when a group scope is provided
1645        behaves like enables a feature flag
1646D, [2021-07-20T14:59:50.410354 #49] DEBUG -- : 
1647Starting test: QA::Runtime::Feature feature_flag: :a_flag .enable when a group scope is provided behaves like enables a feature flag enables a feature flag for a scope
1648D, [2021-07-20T14:59:50.411467 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1649D, [2021-07-20T14:59:50.411514 #49] DEBUG -- : Attempt number 1
1650D, [2021-07-20T14:59:50.411717 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1651D, [2021-07-20T14:59:50.411956 #49] DEBUG -- : ended wait_until
1652D, [2021-07-20T14:59:50.412097 #49] DEBUG -- : ended retry_on_exception
1653          enables a feature flag for a scope
1654      when a user scope is provided
1655        behaves like enables a feature flag
1656D, [2021-07-20T14:59:50.413286 #49] DEBUG -- : 
1657Starting test: QA::Runtime::Feature feature_flag: :a_flag .enable when a user scope is provided behaves like enables a feature flag enables a feature flag for a scope
1658D, [2021-07-20T14:59:50.414260 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1659D, [2021-07-20T14:59:50.414303 #49] DEBUG -- : Attempt number 1
1660D, [2021-07-20T14:59:50.414485 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1661D, [2021-07-20T14:59:50.414692 #49] DEBUG -- : ended wait_until
1662D, [2021-07-20T14:59:50.414826 #49] DEBUG -- : ended retry_on_exception
1663          enables a feature flag for a scope
1664    .disable
1665D, [2021-07-20T14:59:50.415985 #49] DEBUG -- : 
1666Starting test: QA::Runtime::Feature feature_flag: :a_flag .disable disables a feature flag
1667I, [2021-07-20T14:59:50.416784 #49]  INFO -- : Disabling feature: a_flag
1668D, [2021-07-20T14:59:50.416831 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1669D, [2021-07-20T14:59:50.416866 #49] DEBUG -- : Attempt number 1
1670D, [2021-07-20T14:59:50.417100 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1671D, [2021-07-20T14:59:50.417349 #49] DEBUG -- : ended wait_until
1672I, [2021-07-20T14:59:50.417420 #49]  INFO -- : Successfully disabled and verified feature flag: a_flag
1673D, [2021-07-20T14:59:50.417447 #49] DEBUG -- : ended retry_on_exception
1674      disables a feature flag
1675      when a feature group scope is provided
1676        behaves like disables a feature flag
1677D, [2021-07-20T14:59:50.418983 #49] DEBUG -- : 
1678Starting test: QA::Runtime::Feature feature_flag: :a_flag .disable when a feature group scope is provided behaves like disables a feature flag disables a feature flag for a scope
1679D, [2021-07-20T14:59:50.420140 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1680D, [2021-07-20T14:59:50.420195 #49] DEBUG -- : Attempt number 1
1681D, [2021-07-20T14:59:50.420442 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1682D, [2021-07-20T14:59:50.420689 #49] DEBUG -- : ended wait_until
1683D, [2021-07-20T14:59:50.420884 #49] DEBUG -- : ended retry_on_exception
1684          disables a feature flag for a scope
1685      when a user scope is provided
1686        behaves like disables a feature flag
1687D, [2021-07-20T14:59:50.422530 #49] DEBUG -- : 
1688Starting test: QA::Runtime::Feature feature_flag: :a_flag .disable when a user scope is provided behaves like disables a feature flag disables a feature flag for a scope
1689D, [2021-07-20T14:59:50.423733 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1690D, [2021-07-20T14:59:50.423820 #49] DEBUG -- : Attempt number 1
1691D, [2021-07-20T14:59:50.424028 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1692D, [2021-07-20T14:59:50.424292 #49] DEBUG -- : ended wait_until
1693D, [2021-07-20T14:59:50.424412 #49] DEBUG -- : ended retry_on_exception
1694          disables a feature flag for a scope
1695      when a group scope is provided
1696        behaves like disables a feature flag
1697D, [2021-07-20T14:59:50.426144 #49] DEBUG -- : 
1698Starting test: QA::Runtime::Feature feature_flag: :a_flag .disable when a group scope is provided behaves like disables a feature flag disables a feature flag for a scope
1699D, [2021-07-20T14:59:50.427296 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1700D, [2021-07-20T14:59:50.427358 #49] DEBUG -- : Attempt number 1
1701D, [2021-07-20T14:59:50.427556 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1702D, [2021-07-20T14:59:50.427801 #49] DEBUG -- : ended wait_until
1703D, [2021-07-20T14:59:50.427888 #49] DEBUG -- : ended retry_on_exception
1704          disables a feature flag for a scope
1705      when a project scope is provided
1706        behaves like disables a feature flag
1707D, [2021-07-20T14:59:50.429223 #49] DEBUG -- : 
1708Starting test: QA::Runtime::Feature feature_flag: :a_flag .disable when a project scope is provided behaves like disables a feature flag disables a feature flag for a scope
1709D, [2021-07-20T14:59:50.430177 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1710D, [2021-07-20T14:59:50.430229 #49] DEBUG -- : Attempt number 1
1711D, [2021-07-20T14:59:50.430418 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1712D, [2021-07-20T14:59:50.430638 #49] DEBUG -- : ended wait_until
1713D, [2021-07-20T14:59:50.430741 #49] DEBUG -- : ended retry_on_exception
1714          disables a feature flag for a scope
1715    .enabled?
1716D, [2021-07-20T14:59:50.432013 #49] DEBUG -- : 
1717Starting test: QA::Runtime::Feature feature_flag: :a_flag .enabled? returns a feature flag state
1718      returns a feature flag state
1719      when a user scope is provided
1720        behaves like checks a feature flag
1721          when the flag is enabled for a scope
1722D, [2021-07-20T14:59:50.434034 #49] DEBUG -- : 
1723Starting test: QA::Runtime::Feature feature_flag: :a_flag .enabled? when a user scope is provided behaves like checks a feature flag when the flag is enabled for a scope returns the feature flag state
1724            returns the feature flag state
1725      when a feature group scope is provided
1726        behaves like checks a feature flag
1727          when the flag is enabled for a scope
1728D, [2021-07-20T14:59:50.436521 #49] DEBUG -- : 
1729Starting test: QA::Runtime::Feature feature_flag: :a_flag .enabled? when a feature group scope is provided behaves like checks a feature flag when the flag is enabled for a scope returns the feature flag state
1730            returns the feature flag state
1731      when a group scope is provided
1732        behaves like checks a feature flag
1733          when the flag is enabled for a scope
1734D, [2021-07-20T14:59:50.438608 #49] DEBUG -- : 
1735Starting test: QA::Runtime::Feature feature_flag: :a_flag .enabled? when a group scope is provided behaves like checks a feature flag when the flag is enabled for a scope returns the feature flag state
1736            returns the feature flag state
1737      when a project scope is provided
1738        behaves like checks a feature flag
1739          when the flag is enabled for a scope
1740D, [2021-07-20T14:59:50.440911 #49] DEBUG -- : 
1741Starting test: QA::Runtime::Feature feature_flag: :a_flag .enabled? when a project scope is provided behaves like checks a feature flag when the flag is enabled for a scope returns the feature flag state
1742            returns the feature flag state
1743  feature_flag: "a_flag"
1744    .enabled?
1745D, [2021-07-20T14:59:50.442996 #49] DEBUG -- : 
1746Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enabled? returns a feature flag state
1747      returns a feature flag state
1748      when a feature group scope is provided
1749        behaves like checks a feature flag
1750          when the flag is enabled for a scope
1751D, [2021-07-20T14:59:50.445244 #49] DEBUG -- : 
1752Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enabled? when a feature group scope is provided behaves like checks a feature flag when the flag is enabled for a scope returns the feature flag state
1753            returns the feature flag state
1754      when a project scope is provided
1755        behaves like checks a feature flag
1756          when the flag is enabled for a scope
1757D, [2021-07-20T14:59:50.447507 #49] DEBUG -- : 
1758Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enabled? when a project scope is provided behaves like checks a feature flag when the flag is enabled for a scope returns the feature flag state
1759            returns the feature flag state
1760      when a group scope is provided
1761        behaves like checks a feature flag
1762          when the flag is enabled for a scope
1763D, [2021-07-20T14:59:50.449911 #49] DEBUG -- : 
1764Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enabled? when a group scope is provided behaves like checks a feature flag when the flag is enabled for a scope returns the feature flag state
1765            returns the feature flag state
1766      when a user scope is provided
1767        behaves like checks a feature flag
1768          when the flag is enabled for a scope
1769D, [2021-07-20T14:59:50.452338 #49] DEBUG -- : 
1770Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enabled? when a user scope is provided behaves like checks a feature flag when the flag is enabled for a scope returns the feature flag state
1771            returns the feature flag state
1772    .enable
1773D, [2021-07-20T14:59:50.454731 #49] DEBUG -- : 
1774Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enable enables a feature flag
1775I, [2021-07-20T14:59:50.455776 #49]  INFO -- : Enabling feature: a_flag
1776D, [2021-07-20T14:59:50.455834 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1777D, [2021-07-20T14:59:50.455874 #49] DEBUG -- : Attempt number 1
1778D, [2021-07-20T14:59:50.456211 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1779D, [2021-07-20T14:59:50.456572 #49] DEBUG -- : ended wait_until
1780I, [2021-07-20T14:59:50.456614 #49]  INFO -- : Successfully enabled and verified feature flag: a_flag
1781D, [2021-07-20T14:59:50.456641 #49] DEBUG -- : ended retry_on_exception
1782      enables a feature flag
1783      when a project scope is provided
1784        behaves like enables a feature flag
1785D, [2021-07-20T14:59:50.458409 #49] DEBUG -- : 
1786Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enable when a project scope is provided behaves like enables a feature flag enables a feature flag for a scope
1787D, [2021-07-20T14:59:50.459588 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1788D, [2021-07-20T14:59:50.459635 #49] DEBUG -- : Attempt number 1
1789D, [2021-07-20T14:59:50.459952 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1790D, [2021-07-20T14:59:50.460270 #49] DEBUG -- : ended wait_until
1791D, [2021-07-20T14:59:50.460360 #49] DEBUG -- : ended retry_on_exception
1792          enables a feature flag for a scope
1793      when a group scope is provided
1794        behaves like enables a feature flag
1795D, [2021-07-20T14:59:50.462064 #49] DEBUG -- : 
1796Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enable when a group scope is provided behaves like enables a feature flag enables a feature flag for a scope
1797D, [2021-07-20T14:59:50.463104 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1798D, [2021-07-20T14:59:50.463148 #49] DEBUG -- : Attempt number 1
1799D, [2021-07-20T14:59:50.463514 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1800D, [2021-07-20T14:59:50.463884 #49] DEBUG -- : ended wait_until
1801D, [2021-07-20T14:59:50.463977 #49] DEBUG -- : ended retry_on_exception
1802          enables a feature flag for a scope
1803      when a user scope is provided
1804        behaves like enables a feature flag
1805D, [2021-07-20T14:59:50.465337 #49] DEBUG -- : 
1806Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enable when a user scope is provided behaves like enables a feature flag enables a feature flag for a scope
1807D, [2021-07-20T14:59:50.466298 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1808D, [2021-07-20T14:59:50.466340 #49] DEBUG -- : Attempt number 1
1809D, [2021-07-20T14:59:50.466508 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1810D, [2021-07-20T14:59:50.466727 #49] DEBUG -- : ended wait_until
1811D, [2021-07-20T14:59:50.466832 #49] DEBUG -- : ended retry_on_exception
1812          enables a feature flag for a scope
1813      when a feature group scope is provided
1814        behaves like enables a feature flag
1815D, [2021-07-20T14:59:50.468028 #49] DEBUG -- : 
1816Starting test: QA::Runtime::Feature feature_flag: "a_flag" .enable when a feature group scope is provided behaves like enables a feature flag enables a feature flag for a scope
1817D, [2021-07-20T14:59:50.468991 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1818D, [2021-07-20T14:59:50.469033 #49] DEBUG -- : Attempt number 1
1819D, [2021-07-20T14:59:50.469208 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1820D, [2021-07-20T14:59:50.469468 #49] DEBUG -- : ended wait_until
1821D, [2021-07-20T14:59:50.469594 #49] DEBUG -- : ended retry_on_exception
1822          enables a feature flag for a scope
1823    .disable
1824D, [2021-07-20T14:59:50.470705 #49] DEBUG -- : 
1825Starting test: QA::Runtime::Feature feature_flag: "a_flag" .disable disables a feature flag
1826I, [2021-07-20T14:59:50.471503 #49]  INFO -- : Disabling feature: a_flag
1827D, [2021-07-20T14:59:50.471552 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1828D, [2021-07-20T14:59:50.471584 #49] DEBUG -- : Attempt number 1
1829D, [2021-07-20T14:59:50.471873 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1830D, [2021-07-20T14:59:50.472102 #49] DEBUG -- : ended wait_until
1831I, [2021-07-20T14:59:50.472186 #49]  INFO -- : Successfully disabled and verified feature flag: a_flag
1832D, [2021-07-20T14:59:50.472214 #49] DEBUG -- : ended retry_on_exception
1833      disables a feature flag
1834      when a project scope is provided
1835        behaves like disables a feature flag
1836D, [2021-07-20T14:59:50.473772 #49] DEBUG -- : 
1837Starting test: QA::Runtime::Feature feature_flag: "a_flag" .disable when a project scope is provided behaves like disables a feature flag disables a feature flag for a scope
1838D, [2021-07-20T14:59:50.475081 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1839D, [2021-07-20T14:59:50.475140 #49] DEBUG -- : Attempt number 1
1840D, [2021-07-20T14:59:50.475390 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1841D, [2021-07-20T14:59:50.475717 #49] DEBUG -- : ended wait_until
1842D, [2021-07-20T14:59:50.475831 #49] DEBUG -- : ended retry_on_exception
1843          disables a feature flag for a scope
1844      when a feature group scope is provided
1845        behaves like disables a feature flag
1846D, [2021-07-20T14:59:50.477573 #49] DEBUG -- : 
1847Starting test: QA::Runtime::Feature feature_flag: "a_flag" .disable when a feature group scope is provided behaves like disables a feature flag disables a feature flag for a scope
1848D, [2021-07-20T14:59:50.478879 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1849D, [2021-07-20T14:59:50.478954 #49] DEBUG -- : Attempt number 1
1850D, [2021-07-20T14:59:50.479183 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1851D, [2021-07-20T14:59:50.479504 #49] DEBUG -- : ended wait_until
1852D, [2021-07-20T14:59:50.479629 #49] DEBUG -- : ended retry_on_exception
1853          disables a feature flag for a scope
1854      when a group scope is provided
1855        behaves like disables a feature flag
1856D, [2021-07-20T14:59:50.481310 #49] DEBUG -- : 
1857Starting test: QA::Runtime::Feature feature_flag: "a_flag" .disable when a group scope is provided behaves like disables a feature flag disables a feature flag for a scope
1858D, [2021-07-20T14:59:50.482466 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1859D, [2021-07-20T14:59:50.482515 #49] DEBUG -- : Attempt number 1
1860D, [2021-07-20T14:59:50.482702 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1861D, [2021-07-20T14:59:50.482914 #49] DEBUG -- : ended wait_until
1862D, [2021-07-20T14:59:50.483034 #49] DEBUG -- : ended retry_on_exception
1863          disables a feature flag for a scope
1864      when a user scope is provided
1865        behaves like disables a feature flag
1866D, [2021-07-20T14:59:50.484466 #49] DEBUG -- : 
1867Starting test: QA::Runtime::Feature feature_flag: "a_flag" .disable when a user scope is provided behaves like disables a feature flag disables a feature flag for a scope
1868D, [2021-07-20T14:59:50.485604 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 2 
1869D, [2021-07-20T14:59:50.485648 #49] DEBUG -- : Attempt number 1
1870D, [2021-07-20T14:59:50.485938 #49] DEBUG -- : with wait_until: max_duration: 60; reload_page: ; sleep_interval: 1; raise_on_failure: true 
1871D, [2021-07-20T14:59:50.486334 #49] DEBUG -- : ended wait_until
1872D, [2021-07-20T14:59:50.489221 #49] DEBUG -- : ended retry_on_exception
1873          disables a feature flag for a scope
1874QA::Specs::Helpers::Quarantine
1875  .skip_or_run_quarantined_tests_or_contexts
1876    with no tag focused
1877D, [2021-07-20T14:59:50.495242 #49] DEBUG -- : 
1878Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused executes non-quarantined tests
1879      executes non-quarantined tests
1880D, [2021-07-20T14:59:50.496988 #49] DEBUG -- : 
1881Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused skips quarantined tests
1882      skips quarantined tests
1883      with environment set
1884        no pipeline specified
1885D, [2021-07-20T14:59:50.499020 #49] DEBUG -- : 
1886Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused with environment set no pipeline specified is skipped when set on contexts or descriptions
1887          is skipped when set on contexts or descriptions
1888D, [2021-07-20T14:59:50.500625 #49] DEBUG -- : 
1889Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused with environment set no pipeline specified is skipped only in staging
1890          is skipped only in staging
1891        multiple pipelines specified
1892          behaves like skipped in project
1893D, [2021-07-20T14:59:50.503364 #49] DEBUG -- : 
1894Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused with environment set multiple pipelines specified behaves like skipped in project is skipped in STAGING
1895            is skipped in STAGING
1896          behaves like skipped in project
1897D, [2021-07-20T14:59:50.506937 #49] DEBUG -- : 
1898Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused with environment set multiple pipelines specified behaves like skipped in project is skipped in PRODUCTION
1899            is skipped in PRODUCTION
1900          behaves like skipped in project
1901D, [2021-07-20T14:59:50.510079 #49] DEBUG -- : 
1902Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused with environment set multiple pipelines specified behaves like skipped in project is skipped in CANARY
1903            is skipped in CANARY
1904      quarantine message
1905        behaves like test with quarantine message
1906D, [2021-07-20T14:59:50.513358 #49] DEBUG -- : 
1907Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused quarantine message behaves like test with quarantine message outputs the quarantine message
1908          outputs the quarantine message
1909        behaves like test with quarantine message
1910D, [2021-07-20T14:59:50.515058 #49] DEBUG -- : 
1911Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with no tag focused quarantine message behaves like test with quarantine message outputs the quarantine message
1912          outputs the quarantine message
1913    with :quarantine focused
1914D, [2021-07-20T14:59:50.516893 #49] DEBUG -- : 
1915Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with :quarantine focused ignores non-quarantined tests
1916      ignores non-quarantined tests
1917D, [2021-07-20T14:59:50.518279 #49] DEBUG -- : 
1918Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with :quarantine focused executes quarantined tests
1919      executes quarantined tests
1920    with a non-quarantine tag focused
1921D, [2021-07-20T14:59:50.520438 #49] DEBUG -- : 
1922Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with a non-quarantine tag focused skips quarantined focused tests
1923      skips quarantined focused tests
1924D, [2021-07-20T14:59:50.522156 #49] DEBUG -- : 
1925Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with a non-quarantine tag focused ignores quarantined tests
1926      ignores quarantined tests
1927D, [2021-07-20T14:59:50.523552 #49] DEBUG -- : 
1928Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with a non-quarantine tag focused executes non-quarantined focused tests
1929      executes non-quarantined focused tests
1930D, [2021-07-20T14:59:50.525107 #49] DEBUG -- : 
1931Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with a non-quarantine tag focused ignores non-quarantined non-focused tests
1932      ignores non-quarantined non-focused tests
1933    with :quarantine and non-quarantine tags focused
1934D, [2021-07-20T14:59:50.526651 #49] DEBUG -- : 
1935Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with :quarantine and non-quarantine tags focused executes quarantined focused tests
1936      executes quarantined focused tests
1937D, [2021-07-20T14:59:50.528256 #49] DEBUG -- : 
1938Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with :quarantine and non-quarantine tags focused skips non-quarantined focused tests
1939      skips non-quarantined focused tests
1940D, [2021-07-20T14:59:50.529837 #49] DEBUG -- : 
1941Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with :quarantine and non-quarantine tags focused ignores non-quarantined non-focused tests
1942      ignores non-quarantined non-focused tests
1943D, [2021-07-20T14:59:50.531217 #49] DEBUG -- : 
1944Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_tests_or_contexts with :quarantine and non-quarantine tags focused skips quarantined non-focused tests
1945      skips quarantined non-focused tests
1946  .skip_or_run_quarantined_contexts
1947    with :quarantine focused
1948D, [2021-07-20T14:59:50.533225 #49] DEBUG -- : 
1949Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_contexts with :quarantine focused executes before hooks of quarantined contexts
1950      executes before hooks of quarantined contexts
1951D, [2021-07-20T14:59:50.534842 #49] DEBUG -- : 
1952Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_contexts with :quarantine focused skips before hooks of non-quarantined contexts
1953      skips before hooks of non-quarantined contexts
1954    with no tag focused
1955D, [2021-07-20T14:59:50.536332 #49] DEBUG -- : 
1956Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_contexts with no tag focused executes before hooks of non-quarantined contexts
1957      executes before hooks of non-quarantined contexts
1958D, [2021-07-20T14:59:50.537873 #49] DEBUG -- : 
1959Starting test: QA::Specs::Helpers::Quarantine.skip_or_run_quarantined_contexts with no tag focused skips before hooks of quarantined contexts
1960      skips before hooks of quarantined contexts
1961QA::Scenario::Test::Sanity::Selectors
1962  when there are errors detected
1963D, [2021-07-20T14:59:50.544915 #49] DEBUG -- : 
1964Starting test: QA::Scenario::Test::Sanity::Selectors when there are errors detected outputs information about errors
1965Views / selectors validation passed!
1966Views / selectors validation passed!
1967    outputs information about errors
1968  when there are no errors detected
1969D, [2021-07-20T14:59:50.546987 #49] DEBUG -- : 
1970Starting test: QA::Scenario::Test::Sanity::Selectors when there are no errors detected processes pages module
1971Views / selectors validation passed!
1972    processes pages module
1973D, [2021-07-20T14:59:50.548435 #49] DEBUG -- : 
1974Starting test: QA::Scenario::Test::Sanity::Selectors when there are no errors detected triggers validation
1975Views / selectors validation passed!
1976    triggers validation
1977QA::Page::Base
1978  elements
1979    #elements
1980D, [2021-07-20T14:59:50.555053 #49] DEBUG -- : 
1981Starting test: QA::Page::Base elements #elements returns all elements
1982      returns all elements
1983    #required_elements
1984D, [2021-07-20T14:59:50.556347 #49] DEBUG -- : 
1985Starting test: QA::Page::Base elements #required_elements returns only required elements
1986      returns only required elements
1987    #visible? Page is currently visible
1988      with elements
1989D, [2021-07-20T14:59:50.557652 #49] DEBUG -- : 
1990Starting test: QA::Page::Base elements #visible? Page is currently visible with elements does not raise error if page has elements
1991D, [2021-07-20T14:59:50.561402 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 0.5 
1992D, [2021-07-20T14:59:50.561456 #49] DEBUG -- : Attempt number 1
1993D, [2021-07-20T14:59:50.568381 #49] DEBUG -- : ended retry_on_exception
1994        does not raise error if page has elements
1995        on the page
1996D, [2021-07-20T14:59:50.579876 #49] DEBUG -- : 
1997Starting test: QA::Page::Base elements #visible? Page is currently visible with elements on the page is visible
1998          is visible
1999        not on the page
2000D, [2021-07-20T14:59:50.581476 #49] DEBUG -- : 
2001Starting test: QA::Page::Base elements #visible? Page is currently visible with elements not on the page is not visible
2002          is not visible
2003      no elements
2004D, [2021-07-20T14:59:50.582970 #49] DEBUG -- : 
2005Starting test: QA::Page::Base elements #visible? Page is currently visible no elements raises error if page has no required elements
2006        raises error if page has no required elements
2007  page helpers
2008D, [2021-07-20T14:59:50.584222 #49] DEBUG -- : 
2009Starting test: QA::Page::Base page helpers exposes helpful page helpers
2010    exposes helpful page helpers
2011  .errors
2012    when page has views and elements defined
2013D, [2021-07-20T14:59:50.585470 #49] DEBUG -- : 
2014Starting test: QA::Page::Base.errors when page has views and elements defined iterates views composite and returns errors
2015      iterates views composite and returns errors
2016    when page has no views and elements defined
2017D, [2021-07-20T14:59:50.587058 #49] DEBUG -- : 
2018Starting test: QA::Page::Base.errors when page has no views and elements defined appends an error about missing views / elements block
2019      appends an error about missing views / elements block
2020  #all_elements
2021D, [2021-07-20T14:59:50.588490 #49] DEBUG -- : 
2022Starting test: QA::Page::Base#all_elements raises an error if count or minimum are not specified
2023    raises an error if count or minimum are not specified
2024D, [2021-07-20T14:59:50.589616 #49] DEBUG -- : 
2025Starting test: QA::Page::Base#all_elements does not raise an error if :minimum, :maximum, :count, or :between is specified
2026D, [2021-07-20T14:59:50.593486 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 0.5 
2027D, [2021-07-20T14:59:50.593540 #49] DEBUG -- : Attempt number 1
2028D, [2021-07-20T14:59:50.600178 #49] DEBUG -- : ended retry_on_exception
2029D, [2021-07-20T14:59:50.603475 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 0.5 
2030D, [2021-07-20T14:59:50.603523 #49] DEBUG -- : Attempt number 1
2031D, [2021-07-20T14:59:50.609311 #49] DEBUG -- : ended retry_on_exception
2032D, [2021-07-20T14:59:50.612454 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 0.5 
2033D, [2021-07-20T14:59:50.612502 #49] DEBUG -- : Attempt number 1
2034D, [2021-07-20T14:59:50.618836 #49] DEBUG -- : ended retry_on_exception
2035D, [2021-07-20T14:59:50.622438 #49] DEBUG -- : with retry_on_exception: max_attempts: 3; reload_page: ; sleep_interval: 0.5 
2036D, [2021-07-20T14:59:50.622511 #49] DEBUG -- : Attempt number 1
2037D, [2021-07-20T14:59:50.629707 #49] DEBUG -- : ended retry_on_exception
2038    does not raise an error if :minimum, :maximum, :count, or :between is specified
2039  #wait_until
2040    when the condition is true
2041D, [2021-07-20T14:59:50.631631 #49] DEBUG -- : 
2042Starting test: QA::Page::Base#wait_until when the condition is true does not refresh
2043D, [2021-07-20T14:59:50.632044 #49] DEBUG -- : with wait_until: max_duration: 0.01; reload_page: ; sleep_interval: 0.1; raise_on_failure: false 
2044D, [2021-07-20T14:59:50.632110 #49] DEBUG -- : ended wait_until
2045      does not refresh
2046D, [2021-07-20T14:59:50.633125 #49] DEBUG -- : 
2047Starting test: QA::Page::Base#wait_until when the condition is true returns true
2048D, [2021-07-20T14:59:50.633211 #49] DEBUG -- : with wait_until: max_duration: 0.1; reload_page: ; sleep_interval: 0.1; raise_on_failure: false 
2049D, [2021-07-20T14:59:50.633278 #49] DEBUG -- : ended wait_until
2050      returns true
2051    when the condition is false
2052D, [2021-07-20T14:59:50.634379 #49] DEBUG -- : 
2053Starting test: QA::Page::Base#wait_until when the condition is false refreshes
2054D, [2021-07-20T14:59:50.634655 #49] DEBUG -- : with wait_until: max_duration: 0.01; reload_page: ; sleep_interval: 0.1; raise_on_failure: false 
2055D, [2021-07-20T14:59:50.735089 #49] DEBUG -- : ended wait_until
2056      refreshes
2057D, [2021-07-20T14:59:50.736653 #49] DEBUG -- : 
2058Starting test: QA::Page::Base#wait_until when the condition is false returns false
2059D, [2021-07-20T14:59:50.737070 #49] DEBUG -- : with wait_until: max_duration: 0.01; reload_page: ; sleep_interval: 0.1; raise_on_failure: false 
2060D, [2021-07-20T14:59:50.837512 #49] DEBUG -- : ended wait_until
2061      returns false
2062  .view DSL for defining view partials
2063D, [2021-07-20T14:59:50.839576 #49] DEBUG -- : 
2064Starting test: QA::Page::Base.view DSL for defining view partials populates views objects with data about elements
2065    populates views objects with data about elements
2066D, [2021-07-20T14:59:50.843277 #49] DEBUG -- : 
2067Starting test: QA::Page::Base.view DSL for defining view partials makes it possible to define page views
2068    makes it possible to define page views
2069QA::Resource::User
2070  #public_email
2071D, [2021-07-20T14:59:50.849023 #49] DEBUG -- : 
2072Starting test: QA::Resource::User#public_email defaults to QA::Runtime::User.default_email if the public_email from the api_resource is blank
2073    defaults to QA::Runtime::User.default_email if the public_email from the api_resource is blank
2074D, [2021-07-20T14:59:50.850167 #49] DEBUG -- : 
2075Starting test: QA::Resource::User#public_email defaults to QA::Runtime::User.default_email
2076    defaults to QA::Runtime::User.default_email
2077D, [2021-07-20T14:59:50.851155 #49] DEBUG -- : 
2078Starting test: QA::Resource::User#public_email retrieves the public_email from the api_resource if present
2079    retrieves the public_email from the api_resource if present
2080  #password
2081D, [2021-07-20T14:59:50.852272 #49] DEBUG -- : 
2082Starting test: QA::Resource::User#password generates a default password
2083    generates a default password
2084D, [2021-07-20T14:59:50.853216 #49] DEBUG -- : 
2085Starting test: QA::Resource::User#password is possible to set the password
2086    is possible to set the password
2087  #name
2088D, [2021-07-20T14:59:50.854312 #49] DEBUG -- : 
2089Starting test: QA::Resource::User#name retrieves the name from the api_resource if present
2090    retrieves the name from the api_resource if present
2091D, [2021-07-20T14:59:50.855319 #49] DEBUG -- : 
2092Starting test: QA::Resource::User#name defaults to a name based on the username
2093    defaults to a name based on the username
2094D, [2021-07-20T14:59:50.856296 #49] DEBUG -- : 
2095Starting test: QA::Resource::User#name is possible to set the name
2096    is possible to set the name
2097  #credentials_given?
2098D, [2021-07-20T14:59:50.857424 #49] DEBUG -- : 
2099Starting test: QA::Resource::User#credentials_given? returns false when username and email have not been overridden
2100    returns false when username and email have not been overridden
2101D, [2021-07-20T14:59:50.858426 #49] DEBUG -- : 
2102Starting test: QA::Resource::User#credentials_given? returns false if only the username has been overridden
2103    returns false if only the username has been overridden
2104D, [2021-07-20T14:59:50.859418 #49] DEBUG -- : 
2105Starting test: QA::Resource::User#credentials_given? returns false if only the password has been overridden
2106    returns false if only the password has been overridden
2107D, [2021-07-20T14:59:50.860413 #49] DEBUG -- : 
2108Starting test: QA::Resource::User#credentials_given? returns false even after username and email have been called
2109    returns false even after username and email have been called
2110D, [2021-07-20T14:59:50.861372 #49] DEBUG -- : 
2111Starting test: QA::Resource::User#credentials_given? returns true if both the username and password have been overridden
2112    returns true if both the username and password have been overridden
2113  #username
2114D, [2021-07-20T14:59:50.862491 #49] DEBUG -- : 
2115Starting test: QA::Resource::User#username generates a default username
2116    generates a default username
2117D, [2021-07-20T14:59:50.863459 #49] DEBUG -- : 
2118Starting test: QA::Resource::User#username is possible to set the username
2119    is possible to set the username
2120  #email
2121D, [2021-07-20T14:59:50.864556 #49] DEBUG -- : 
2122Starting test: QA::Resource::User#email is possible to set the email
2123    is possible to set the email
2124D, [2021-07-20T14:59:50.865499 #49] DEBUG -- : 
2125Starting test: QA::Resource::User#email defaults to the <username>@example.com
2126    defaults to the <username>@example.com
2127QA::Runtime::API::Client
2128  initialization
2129D, [2021-07-20T14:59:50.871836 #49] DEBUG -- : 
2130Starting test: QA::Runtime::API::Client initialization uses specified address
2131    uses specified address
2132D, [2021-07-20T14:59:50.872928 #49] DEBUG -- : 
2133Starting test: QA::Runtime::API::Client initialization defaults to :gitlab address
2134    defaults to :gitlab address
2135  #personal_access_token
2136    when user is present and QA::Runtime::Env.personal_access_token is nil
2137D, [2021-07-20T14:59:50.874078 #49] DEBUG -- : 
2138Starting test: QA::Runtime::API::Client#personal_access_token when user is present and QA::Runtime::Env.personal_access_token is nil returns a created token
2139      returns a created token
2140    when user is present and QA::Runtime::Env.personal_access_token is present
2141D, [2021-07-20T14:59:50.875569 #49] DEBUG -- : 
2142Starting test: QA::Runtime::API::Client#personal_access_token when user is present and QA::Runtime::Env.personal_access_token is present returns a created token
2143      returns a created token
2144    when user is nil and QA::Runtime::Env.personal_access_token is nil
2145D, [2021-07-20T14:59:50.876982 #49] DEBUG -- : 
2146Starting test: QA::Runtime::API::Client#personal_access_token when user is nil and QA::Runtime::Env.personal_access_token is nil returns a created token
2147      returns a created token
2148    when user is nil and QA::Runtime::Env.personal_access_token is present
2149D, [2021-07-20T14:59:50.878262 #49] DEBUG -- : 
2150Starting test: QA::Runtime::API::Client#personal_access_token when user is nil and QA::Runtime::Env.personal_access_token is present returns specified token from env
2151      returns specified token from env
2152QA::Support::SSH
2153  #git_user
2154    when running against environment on a port other than 80 or 443
2155D, [2021-07-20T14:59:50.883663 #49] DEBUG -- : 
2156Starting test: QA::Support::SSH#git_user when running against environment on a port other than 80 or 443 returns the local user
2157      returns the local user
2158    when running against environment on port 80 and not on CI (docker)
2159D, [2021-07-20T14:59:50.885541 #49] DEBUG -- : 
2160Starting test: QA::Support::SSH#git_user when running against environment on port 80 and not on CI (docker) returns git user
2161      returns git user
2162    when running on a review app in CI
2163D, [2021-07-20T14:59:50.887077 #49] DEBUG -- : 
2164Starting test: QA::Support::SSH#git_user when running on a review app in CI returns git user
2165      returns git user
2166    when running on CI
2167D, [2021-07-20T14:59:50.888633 #49] DEBUG -- : 
2168Starting test: QA::Support::SSH#git_user when running on CI returns git user
2169      returns git user
2170  #reset_2fa_codes
2171    behaves like providing correct ports
2172      when other port is specified in uri
2173D, [2021-07-20T14:59:50.890655 #49] DEBUG -- : 
2174Starting test: QA::Support::SSH#reset_2fa_codes behaves like providing correct ports when other port is specified in uri provides other port in ssh command
2175        provides other port in ssh command
2176      when port 80 specified in uri
2177D, [2021-07-20T14:59:50.892474 #49] DEBUG -- : 
2178Starting test: QA::Support::SSH#reset_2fa_codes behaves like providing correct ports when port 80 specified in uri does not provide port in ssh command
2179        does not provide port in ssh command
2180      when no port specified in https uri
2181D, [2021-07-20T14:59:50.894094 #49] DEBUG -- : 
2182Starting test: QA::Support::SSH#reset_2fa_codes behaves like providing correct ports when no port specified in https uri does not provide port in ssh command
2183        does not provide port in ssh command
2184      when no port specified in uri
2185D, [2021-07-20T14:59:50.895687 #49] DEBUG -- : 
2186Starting test: QA::Support::SSH#reset_2fa_codes behaves like providing correct ports when no port specified in uri does not provide port in ssh command
2187        does not provide port in ssh command
2188  #setup
2189    behaves like providing correct ports
2190      when no port specified in https uri
2191D, [2021-07-20T14:59:50.897723 #49] DEBUG -- : 
2192Starting test: QA::Support::SSH#setup behaves like providing correct ports when no port specified in https uri does not provide port in ssh command
2193        does not provide port in ssh command
2194      when other port is specified in uri
2195D, [2021-07-20T14:59:50.899624 #49] DEBUG -- : 
2196Starting test: QA::Support::SSH#setup behaves like providing correct ports when other port is specified in uri provides other port in ssh command
2197        provides other port in ssh command
2198      when no port specified in uri
2199D, [2021-07-20T14:59:50.901479 #49] DEBUG -- : 
2200Starting test: QA::Support::SSH#setup behaves like providing correct ports when no port specified in uri does not provide port in ssh command
2201        does not provide port in ssh command
2202      when port 80 specified in uri
2203D, [2021-07-20T14:59:50.903265 #49] DEBUG -- : 
2204Starting test: QA::Support::SSH#setup behaves like providing correct ports when port 80 specified in uri does not provide port in ssh command
2205        does not provide port in ssh command
2206QA::Scenario::Test::Integration::InstanceSAML
2207  #perform
2208    behaves like a QA scenario class
2209D, [2021-07-20T14:59:50.909310 #49] DEBUG -- : 
2210Starting test: QA::Scenario::Test::Integration::InstanceSAML#perform behaves like a QA scenario class performs before hooks only once
2211      performs before hooks only once
2212D, [2021-07-20T14:59:50.911039 #49] DEBUG -- : 
2213Starting test: QA::Scenario::Test::Integration::InstanceSAML#perform behaves like a QA scenario class sets tags on runner
2214      sets tags on runner
2215D, [2021-07-20T14:59:50.912473 #49] DEBUG -- : 
2216Starting test: QA::Scenario::Test::Integration::InstanceSAML#perform behaves like a QA scenario class sets an address of the subject
2217      sets an address of the subject
2218D, [2021-07-20T14:59:50.913901 #49] DEBUG -- : 
2219Starting test: QA::Scenario::Test::Integration::InstanceSAML#perform behaves like a QA scenario class responds to perform
2220      responds to perform
2221      with named command-line options
2222D, [2021-07-20T14:59:50.915330 #49] DEBUG -- : 
2223Starting test: QA::Scenario::Test::Integration::InstanceSAML#perform behaves like a QA scenario class with named command-line options raises an error if the option is invalid
2224        raises an error if the option is invalid
2225D, [2021-07-20T14:59:50.917158 #49] DEBUG -- : 
2226Starting test: QA::Scenario::Test::Integration::InstanceSAML#perform behaves like a QA scenario class with named command-line options passes on options after --
2227        passes on options after --
2228D, [2021-07-20T14:59:50.918860 #49] DEBUG -- : 
2229Starting test: QA::Scenario::Test::Integration::InstanceSAML#perform behaves like a QA scenario class with named command-line options converts options to attributes
2230        converts options to attributes
2231      specifying RSpec options
2232D, [2021-07-20T14:59:50.920629 #49] DEBUG -- : 
2233Starting test: QA::Scenario::Test::Integration::InstanceSAML#perform behaves like a QA scenario class specifying RSpec options sets options on runner
2234        sets options on runner
2235Top 10 slowest examples (1.14 seconds, 42.4% of total time):
2236  QA::Runtime::Key::RSA#public_key generates a public RSA key
2237    0.32361 seconds ./spec/runtime/key/rsa_spec.rb:7
2238  QA::Resource::SSHKey#key generates a default key
2239    0.17502 seconds ./spec/resource/ssh_key_spec.rb:5
2240  QA::Page::Base#wait_until when the condition is false returns false
2241    0.10216 seconds ./spec/page/base_spec.rb:87
2242  QA::Page::Base#wait_until when the condition is false refreshes
2243    0.10179 seconds ./spec/page/base_spec.rb:81
2244  QA::Resource::Events::Project#wait_for_push raises an error if a push with the specified commit message is not found
2245    0.10163 seconds ./spec/resource/events/project_spec.rb:53
2246  QA::Resource::Events::Project#wait_for_push_new_branch raises an error if a push with the specified branch is not found
2247    0.10151 seconds ./spec/resource/events/project_spec.rb:70
2248  QA::Page::Validator when checking validation errors when there are validation errors #validate! raises validation error
2249    0.08421 seconds ./spec/page/validator_spec.rb:74
2250  QA::Page::Validator#descendants recursively returns all descendants that are page objects
2251    0.07208 seconds ./spec/page/validator_spec.rb:20
2252  QA::Page::Base#all_elements does not raise an error if :minimum, :maximum, :count, or :between is specified
2253    0.0413 seconds ./spec/page/base_spec.rb:104
2254  QA::Runtime::Key::ECDSA#public_key generates a public 521-bits ECDSA key
2255    0.03316 seconds ./spec/runtime/key/ecdsa_spec.rb:6
2256Top 10 slowest example groups:
2257  QA::Runtime::Key::RSA
2258    0.32804 seconds average (0.32804 seconds / 1 example) ./spec/runtime/key/rsa_spec.rb:3
2259  QA::Resource::SSHKey
2260    0.0606 seconds average (0.18179 seconds / 3 examples) ./spec/resource/ssh_key_spec.rb:3
2261  QA::Resource::Events::Project
2262    0.04243 seconds average (0.21216 seconds / 5 examples) ./spec/resource/events/project_spec.rb:3
2263  QA::Page::Validator
2264    0.02737 seconds average (0.19157 seconds / 7 examples) ./spec/page/validator_spec.rb:3
2265  QA::Runtime::Key::ED25519
2266    0.02329 seconds average (0.02329 seconds / 1 example) ./spec/runtime/key/ed25519_spec.rb:3
2267  QA::Runtime::Key::ECDSA
2268    0.021 seconds average (0.08399 seconds / 4 examples) ./spec/runtime/key/ecdsa_spec.rb:3
2269  QA::Page::Base
2270    0.01729 seconds average (0.29397 seconds / 17 examples) ./spec/page/base_spec.rb:3
2271  QA::Specs::ParallelRunner
2272    0.00723 seconds average (0.03614 seconds / 5 examples) ./spec/specs/parallel_runner_spec.rb:3
2273  QA::Runtime::ApplicationSettings
2274    0.00424 seconds average (0.00849 seconds / 2 examples) ./spec/runtime/application_settings_spec.rb:3
2275  QA::Support::WaitForRequests
2276    0.00398 seconds average (0.00795 seconds / 2 examples) ./spec/support/wait_for_requests_spec.rb:3
2277Finished in 2.68 seconds (files took 2.9 seconds to load)
2278602 examples, 0 failures
2279Randomized with seed 56334
 2280  Saving cache for successful job  
  00:01
2281Not uploading cache qa-ruby-gems-v1-4 due to policy
 2282  Cleaning up file based variables  
  00:01
2283Job succeeded
Tags: gitlab-org
Commit 3f8443f2 in !66303
Merge branch 'track-label-and-property-with-scan-event' into 'master'
Related jobs

code_quality
brakeman-sast
compile-storybook
danger-review
db:check-schema
eslint-sast
gitlab_git_test
graphql-verify
jest 1/4
jest 2/4
jest 3/4
jest 4/4
jest-integration
karma
license_scanning
memory-on-boot
memory-static
nodejs-scan-sast
qa:internal
qa:selectors
rspec fail-fast
rspec foss-impact
rspec integration pg12 1/8
rspec integration pg12 2/8
rspec integration pg12 3/8
rspec integration pg12 4/8
rspec integration pg12 5/8
rspec integration pg12 6/8
rspec integration pg12 7/8
rspec integration pg12 8/8
rspec system pg12 1/24
rspec system pg12 10/24
rspec system pg12 11/24
rspec system pg12 12/24
rspec system pg12 13/24
rspec system pg12 14/24
rspec system pg12 15/24
rspec system pg12 16/24
rspec system pg12 17/24
rspec system pg12 18/24
rspec system pg12 19/24
rspec system pg12 2/24
rspec system pg12 20/24
rspec system pg12 21/24
rspec system pg12 22/24
rspec system pg12 23/24
rspec system pg12 24/24
rspec system pg12 3/24
rspec system pg12 4/24
rspec system pg12 5/24
rspec system pg12 6/24
rspec system pg12 7/24
rspec system pg12 8/24
rspec system pg12 9/24
rspec unit pg12 1/20
rspec unit pg12 10/20
rspec unit pg12 11/20
rspec unit pg12 12/20
rspec unit pg12 13/20
rspec unit pg12 14/20
rspec unit pg12 15/20
rspec unit pg12 16/20
rspec unit pg12 17/20
rspec unit pg12 18/20
rspec unit pg12 19/20
rspec unit pg12 2/20
rspec unit pg12 20/20
rspec unit pg12 3/20
rspec unit pg12 4/20
rspec unit pg12 5/20
rspec unit pg12 6/20
rspec unit pg12 7/20
rspec unit pg12 8/20
rspec unit pg12 9/20
rspec-ee integration pg12 1/4
rspec-ee integration pg12 2/4
rspec-ee integration pg12 3/4
rspec-ee integration pg12 4/4
rspec-ee integration pg12 geo
rspec-ee system pg12 1/6
rspec-ee system pg12 2/6
rspec-ee system pg12 3/6
rspec-ee system pg12 4/6
rspec-ee system pg12 5/6
rspec-ee system pg12 6/6
rspec-ee system pg12 geo
rspec-ee unit pg12 1/12
rspec-ee unit pg12 10/12
rspec-ee unit pg12 11/12
rspec-ee unit pg12 12/12
rspec-ee unit pg12 2/12
rspec-ee unit pg12 3/12
rspec-ee unit pg12 4/12
rspec-ee unit pg12 5/12
rspec-ee unit pg12 6/12
rspec-ee unit pg12 7/12
rspec-ee unit pg12 8/12
rspec-ee unit pg12 9/12
rspec-ee unit pg12 geo 1/2
rspec-ee unit pg12 geo 2/2
run-dev-fixtures
run-dev-fixtures-ee
secret_detection
semgrep-sast
startup-css-check
static-analysis 1/4
static-analysis 2/4
static-analysis 3/4
static-analysis 4/4
verify-tests-yml
webpack-dev-server
zeitwerk-check