Multiple 503 errors on ProjectPush on Staging
Summary
There have been multiple 503 errors in various specs on staging usually associated with ProjectPush
- qa/specs/features/ee/browser_ui/secure/security_reports_spec.rb
- qa/specs/features/ee/browser_ui/secure/merge_request_license_widget_spec.rb
- qa/specs/features/api/3_create/merge_request/push_options_labels_spec.rb
- qa/specs/features/browser_ui/3_create/repository/push_over_http_spec.rb
https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/1966556
Stack trace
2) Secure Security Reports displays security reports in the pipeline
Failure/Error:
Resource::Repository::ProjectPush.fabricate! do |push|
push.project = @project
push.directory = Pathname
.new(__dir__)
.join('../../../../../ee/fixtures/secure_premade_reports')
push.commit_message = 'Create Secure compatible application to serve premade reports'
end.project.visit!
QA::Git::Repository::RepositoryCommandError:
The command HOME="/tmp/qa-netrc-credentials/23" git push https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-29-13-37-51-47eb51e3f362eb5a/project-with-secure-f66d1091f33bf0de.git master:master 2>&1 failed (128) with the following output:
fatal: unable to access 'https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-29-13-37-51-47eb51e3f362eb5a/project-with-secure-f66d1091f33bf0de.git/': The requested URL returned error: 503
# ./qa/git/repository.rb:273:in `run'
# ./qa/git/repository.rb:134:in `push_changes'
# ./qa/resource/repository/push.rb:99:in `block in fabricate!'
# ./qa/scenario/actable.rb:16:in `perform'
# ./qa/git/repository.rb:35:in `block (2 levels) in perform'
# ./qa/git/repository.rb:35:in `chdir'
# ./qa/git/repository.rb:35:in `block in perform'
# ./qa/git/repository.rb:34:in `perform'
# ./qa/resource/repository/push.rb:51:in `fabricate!'
# ./qa/resource/repository/project_push.rb:42:in `fabricate!'
# ./qa/resource/base.rb:30:in `block (2 levels) in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:135:in `log_fabrication'
# ./qa/resource/base.rb:30:in `block in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:118:in `do_fabricate!'
# ./qa/resource/base.rb:29:in `fabricate_via_browser_ui!'
# ./qa/resource/base.rb:21:in `rescue in fabricate!'
# ./qa/resource/base.rb:18:in `fabricate!'
# ./qa/specs/features/ee/browser_ui/secure/security_reports_spec.rb:35:in `block (3 levels) in <module:QA>'
https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/1963779
Stack trace
Failures:
1) Secure License merge request widget manage licenses from the merge request
Failure/Error:
Resource::Repository::ProjectPush.fabricate! do |project_push|
project_push.project = @project
project_push.directory = Pathname
.new(__dir__)
.join('../../../../../ee/fixtures/secure_license_files')
project_push.commit_message = 'Create license file'
end
QA::Git::Repository::RepositoryCommandError:
The command HOME="/tmp/qa-netrc-credentials/22" git push https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-29-06-13-46-5dce2067220d8a59/license-widget-project-97f0b718ce3fe451.git master:master 2>&1 failed (128) with the following output:
fatal: unable to access 'https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-29-06-13-46-5dce2067220d8a59/license-widget-project-97f0b718ce3fe451.git/': The requested URL returned error: 503
# ./qa/git/repository.rb:273:in `run'
# ./qa/git/repository.rb:134:in `push_changes'
# ./qa/resource/repository/push.rb:99:in `block in fabricate!'
# ./qa/scenario/actable.rb:16:in `perform'
# ./qa/git/repository.rb:35:in `block (2 levels) in perform'
# ./qa/git/repository.rb:35:in `chdir'
# ./qa/git/repository.rb:35:in `block in perform'
# ./qa/git/repository.rb:34:in `perform'
# ./qa/resource/repository/push.rb:51:in `fabricate!'
# ./qa/resource/repository/project_push.rb:42:in `fabricate!'
# ./qa/resource/base.rb:30:in `block (2 levels) in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:135:in `log_fabrication'
# ./qa/resource/base.rb:30:in `block in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:118:in `do_fabricate!'
# ./qa/resource/base.rb:29:in `fabricate_via_browser_ui!'
# ./qa/resource/base.rb:21:in `rescue in fabricate!'
# ./qa/resource/base.rb:18:in `fabricate!'
# ./qa/specs/features/ee/browser_ui/secure/merge_request_license_widget_spec.rb:30:in `block (3 levels) in <module:QA>'
https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/1966251
Stack trace
Failures:
1) Secure License merge request widget manage licenses from the merge request
Failure/Error:
@merge_request = Resource::MergeRequest.fabricate_via_api! do |mr|
mr.project = @project
mr.source_branch = 'license-management-mr'
mr.target_branch = 'master'
mr.target = 'master'
mr.file_name = 'gl-license-scanning-report.json'
mr.file_content =
<<~FILE_UPDATE
{
"licenses": [
QA::Git::Repository::RepositoryCommandError:
The command HOME="/tmp/qa-netrc-credentials/25" git push https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-29-12-43-04-d533872c4718c55d/license-widget-project-e8a965feebf479cc.git master:license-management-mr 2>&1 failed (128) with the following output:
fatal: unable to access 'https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-29-12-43-04-d533872c4718c55d/license-widget-project-e8a965feebf479cc.git/': The requested URL returned error: 503
# ./qa/git/repository.rb:273:in `run'
# ./qa/git/repository.rb:134:in `push_changes'
# ./qa/resource/repository/push.rb:99:in `block in fabricate!'
# ./qa/scenario/actable.rb:16:in `perform'
# ./qa/git/repository.rb:35:in `block (2 levels) in perform'
# ./qa/git/repository.rb:35:in `chdir'
# ./qa/git/repository.rb:35:in `block in perform'
# ./qa/git/repository.rb:34:in `perform'
# ./qa/resource/repository/push.rb:51:in `fabricate!'
# ./qa/resource/repository/project_push.rb:42:in `fabricate!'
# ./qa/resource/base.rb:30:in `block (2 levels) in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:135:in `log_fabrication'
# ./qa/resource/base.rb:30:in `block in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:118:in `do_fabricate!'
# ./qa/resource/base.rb:29:in `fabricate_via_browser_ui!'
# ./qa/resource/base.rb:21:in `rescue in fabricate!'
# ./qa/resource/base.rb:18:in `fabricate!'
# ./qa/resource/merge_request.rb:44:in `block in <class:MergeRequest>'
# ./qa/resource/base.rb:108:in `instance_exec'
# ./qa/resource/base.rb:108:in `attribute_value'
# ./qa/resource/base.rb:94:in `populate_attribute'
# ./qa/resource/base.rb:161:in `block (2 levels) in attribute'
# ./qa/resource/base.rb:82:in `public_send'
# ./qa/resource/base.rb:82:in `each'
# ./qa/resource/base.rb:82:in `populate'
# ./qa/resource/merge_request.rb:92:in `rescue in fabricate_via_api!'
# ./qa/resource/merge_request.rb:89:in `fabricate_via_api!'
# ./qa/resource/base.rb:46:in `block (2 levels) in fabricate_via_api!'
# ./qa/resource/base.rb:135:in `log_fabrication'
# ./qa/resource/base.rb:46:in `block in fabricate_via_api!'
# ./qa/resource/base.rb:118:in `do_fabricate!'
# ./qa/resource/base.rb:45:in `fabricate_via_api!'
# ./qa/specs/features/ee/browser_ui/secure/merge_request_license_widget_spec.rb:42:in `block (3 levels) in <module:QA>'
https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/1959717
Stack trace
Failures:
1) Create Merge request push options when labels are set already removes them
Failure/Error:
Resource::Repository::ProjectPush.fabricate! do |push|
push.project = project
push.file_content = "Unlabel test #{SecureRandom.hex(8)}"
push.commit_message = commit_message
push.branch_name = branch
push.new_branch = false
push.merge_request_push_options = {
title: title,
unlabel: %w[one three]
}
QA::Git::Repository::RepositoryCommandError:
The command HOME="/tmp/qa-netrc-credentials/23" git clone https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-28-17-23-13-65fc3643c266d2c5/merge-request-push-options-713d011bd7342695.git ./ 2>&1 failed (128) with the following output:
Cloning into '.'...
error: RPC failed; HTTP 503 curl 22 The requested URL returned error: 503 Service Unavailable
fatal: the remote end hung up unexpectedly
# ./qa/git/repository.rb:269:in `run'
# ./qa/git/repository.rb:67:in `clone'
# ./qa/resource/repository/push.rb:78:in `block in fabricate!'
# ./qa/scenario/actable.rb:16:in `perform'
# ./qa/git/repository.rb:35:in `block (2 levels) in perform'
# ./qa/git/repository.rb:35:in `chdir'
# ./qa/git/repository.rb:35:in `block in perform'
# ./qa/git/repository.rb:34:in `perform'
# ./qa/resource/repository/push.rb:51:in `fabricate!'
# ./qa/resource/repository/project_push.rb:42:in `fabricate!'
# ./qa/resource/base.rb:30:in `block (2 levels) in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:135:in `log_fabrication'
# ./qa/resource/base.rb:30:in `block in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:118:in `do_fabricate!'
# ./qa/resource/base.rb:29:in `fabricate_via_browser_ui!'
# ./qa/resource/base.rb:21:in `rescue in fabricate!'
# ./qa/resource/base.rb:18:in `fabricate!'
# ./qa/specs/features/api/3_create/merge_request/push_options_labels_spec.rb:39:in `block (4 levels) in <module:QA>'
https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/1960253
Stack trace
Failures:
1) Create Git push over HTTP user pushes code to the repository
Failure/Error:
Resource::Repository::ProjectPush.fabricate! do |push|
push.file_name = 'README.md'
push.file_content = '# This is a test project'
push.commit_message = 'Add README.md'
end.project.visit!
QA::Git::Repository::RepositoryCommandError:
The command HOME="/tmp/qa-netrc-credentials/25" git clone https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-28-18-38-39-e96c40f50338d997/project-with-code-3ead4ae6c995574d.git ./ 2>&1 failed (128) with the following output:
Cloning into '.'...
fatal: unable to access 'https://gitlab-qa@staging.gitlab.com/gitlab-qa-sandbox-group/qa-test-2020-09-28-18-38-39-e96c40f50338d997/project-with-code-3ead4ae6c995574d.git/': The requested URL returned error: 503
# ./qa/git/repository.rb:269:in `run'
# ./qa/git/repository.rb:67:in `clone'
# ./qa/resource/repository/push.rb:78:in `block in fabricate!'
# ./qa/scenario/actable.rb:16:in `perform'
# ./qa/git/repository.rb:35:in `block (2 levels) in perform'
# ./qa/git/repository.rb:35:in `chdir'
# ./qa/git/repository.rb:35:in `block in perform'
# ./qa/git/repository.rb:34:in `perform'
# ./qa/resource/repository/push.rb:51:in `fabricate!'
# ./qa/resource/repository/project_push.rb:42:in `fabricate!'
# ./qa/resource/base.rb:30:in `block (2 levels) in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:135:in `log_fabrication'
# ./qa/resource/base.rb:30:in `block in fabricate_via_browser_ui!'
# ./qa/resource/base.rb:118:in `do_fabricate!'
# ./qa/resource/base.rb:29:in `fabricate_via_browser_ui!'
# ./qa/resource/base.rb:21:in `rescue in fabricate!'
# ./qa/resource/base.rb:18:in `fabricate!'
# ./qa/specs/features/browser_ui/3_create/repository/push_over_http_spec.rb:9:in `block (3 levels) in <module:QA>'