metrics:trace-pipeline fails because gprd-track has not finished
https://ops.gitlab.net/gitlab-org/release/tools/-/jobs/11927810
2023-11-17 10:58:55.787763 I ReleaseTools::PipelineTracer::Pipeline -- Start time of pipeline -- {:pipeline_url=>"https://ops.gitlab.net/gitlab-com/gl-infra/deployer/-/pipelines/2535741", :started_at=>"2023-11-17T09:58:11.015Z", :created_at=>"2023-11-17T09:58:08.573Z"}
2023-11-17 11:01:03.683889 E [18:SemanticLogger::Appenders] SemanticLogger::Appenders -- Failed to log to appender: SemanticLogger::Appender::ElasticsearchHttp -- Exception: Net::ReadTimeout: Net::ReadTimeout with #<TCPSocket:(closed)>
/usr/local/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill'
/usr/local/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil'
/usr/local/lib/ruby/3.2.0/net/protocol.rb:209:in `readline'
/usr/local/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line'
/usr/local/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new'
/usr/local/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request'
/usr/local/lib/ruby/3.2.0/net/http.rb:1853:in `catch'
/usr/local/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request'
/usr/local/lib/ruby/3.2.0/net/http.rb:1826:in `request'
/usr/local/bundle/gems/sentry-ruby-5.13.0/lib/sentry/net/http.rb:29:in `request'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/http.rb:234:in `process_request'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/http.rb:213:in `post'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/elasticsearch_http.rb:70:in `log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:31:in `block in log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:30:in `each'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:30:in `log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:152:in `process_messages'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:121:in `process'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:77:in `block in thread'
2023-11-17 11:01:20.458537 E [18:SemanticLogger::Appenders] SemanticLogger::Appenders -- Failed to log to appender: SemanticLogger::Appender::ElasticsearchHttp -- Exception: Net::ReadTimeout: Net::ReadTimeout with #<TCPSocket:(closed)>
/usr/local/lib/ruby/3.2.0/net/protocol.rb:229:in `rbuf_fill'
/usr/local/lib/ruby/3.2.0/net/protocol.rb:199:in `readuntil'
/usr/local/lib/ruby/3.2.0/net/protocol.rb:209:in `readline'
/usr/local/lib/ruby/3.2.0/net/http/response.rb:158:in `read_status_line'
/usr/local/lib/ruby/3.2.0/net/http/response.rb:147:in `read_new'
/usr/local/lib/ruby/3.2.0/net/http.rb:1862:in `block in transport_request'
/usr/local/lib/ruby/3.2.0/net/http.rb:1853:in `catch'
/usr/local/lib/ruby/3.2.0/net/http.rb:1853:in `transport_request'
/usr/local/lib/ruby/3.2.0/net/http.rb:1826:in `request'
/usr/local/bundle/gems/sentry-ruby-5.13.0/lib/sentry/net/http.rb:29:in `request'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/http.rb:234:in `process_request'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/http.rb:213:in `post'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/elasticsearch_http.rb:70:in `log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:31:in `block in log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:30:in `each'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:30:in `log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:152:in `process_messages'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:121:in `process'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:77:in `block in thread'
2023-11-17 10:58:56.173080 D ReleaseTools::GitlabOpsClient -- [HTTParty] [2023-11-17 10:58:56 +0000] 200 "GET https://ops.gitlab.net/api/v4/projects/gitlab-com%2Fgl-infra%2Fdeployer/pipelines/2535741/jobs" -
2023-11-17 10:58:56.501335 D ReleaseTools::GitlabOpsClient -- [HTTParty] [2023-11-17 10:58:56 +0000] 200 "GET https://ops.gitlab.net/api/v4/projects/gitlab-com%2Fgl-infra%2Fdeployer/pipelines/2535741/bridges" -
2023-11-17 10:58:56.508796 I ReleaseTools::PipelineTracer::Service -- Tracing pipeline -- {:web_url=>"https://ops.gitlab.net/gitlab-org/release/tools/-/pipelines/2535924"}
2023-11-17 10:58:56.706019 D ReleaseTools::GitlabOpsClient -- [HTTParty] [2023-11-17 10:58:56 +0000] 200 "GET https://ops.gitlab.net/api/v4/projects/gitlab-org%2Frelease%2Ftools/pipelines/2535924" -
2023-11-17 10:58:56.706144 I ReleaseTools::PipelineTracer::Pipeline -- Start time of pipeline -- {:pipeline_url=>"https://ops.gitlab.net/gitlab-org/release/tools/-/pipelines/2535924", :started_at=>"2023-11-17T10:55:51.058Z", :created_at=>"2023-11-17T10:55:49.951Z"}
2023-11-17 10:58:56.930976 D ReleaseTools::GitlabOpsClient -- [HTTParty] [2023-11-17 10:58:56 +0000] 200 "GET https://ops.gitlab.net/api/v4/projects/gitlab-org%2Frelease%2Ftools/pipelines/2535924/jobs" -
2023-11-17 10:58:57.095360 D ReleaseTools::GitlabOpsClient -- [HTTParty] [2023-11-17 10:58:57 +0000] 200 "GET https://ops.gitlab.net/api/v4/projects/gitlab-org%2Frelease%2Ftools/pipelines/2535924/bridges" 2
2023-11-17 10:58:57.095501 I ReleaseTools::PipelineTracer::Pipeline -- Calculating end time -- {:pipeline_url=>"https://ops.gitlab.net/gitlab-org/release/tools/-/pipelines/2535924", :last_job_finished_at=>nil, :last_bridge_job_finished_at=>nil}
2023-11-17 10:58:57.095634 F Rake::Task -- Task failed -- Exception: NoMethodError: undefined method `iso8601' for nil:NilClass
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/pipeline.rb:149:in `calculate_end_time'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/pipeline.rb:87:in `end_time'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:65:in `process_pipeline'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:46:in `execute'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:87:in `block (2 levels) in process_pipeline_bridges'
/usr/local/bundle/gems/gitlab-4.19.0/lib/gitlab/paginated_response.rb:22:in `each'
/usr/local/bundle/gems/gitlab-4.19.0/lib/gitlab/paginated_response.rb:22:in `method_missing'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:78:in `block in process_pipeline_bridges'
/usr/local/bundle/gems/gitlab-4.19.0/lib/gitlab/paginated_response.rb:38:in `each_page'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:77:in `process_pipeline_bridges'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:72:in `block in generate_sub_spans'
/usr/local/bundle/gems/opentelemetry-api-1.2.3/lib/opentelemetry/trace.rb:70:in `block in with_span'
/usr/local/bundle/gems/opentelemetry-api-1.2.3/lib/opentelemetry/context.rb:87:in `with_value'
/usr/local/bundle/gems/opentelemetry-api-1.2.3/lib/opentelemetry/trace.rb:70:in `with_span'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:69:in `generate_sub_spans'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:60:in `process_pipeline'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:46:in `execute'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:87:in `block (2 levels) in process_pipeline_bridges'
/usr/local/bundle/gems/gitlab-4.19.0/lib/gitlab/paginated_response.rb:22:in `each'
/usr/local/bundle/gems/gitlab-4.19.0/lib/gitlab/paginated_response.rb:22:in `method_missing'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:78:in `block in process_pipeline_bridges'
/usr/local/bundle/gems/gitlab-4.19.0/lib/gitlab/paginated_response.rb:38:in `each_page'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:77:in `process_pipeline_bridges'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:72:in `block in generate_sub_spans'
/usr/local/bundle/gems/opentelemetry-api-1.2.3/lib/opentelemetry/trace.rb:70:in `block in with_span'
/usr/local/bundle/gems/opentelemetry-api-1.2.3/lib/opentelemetry/context.rb:87:in `with_value'
/usr/local/bundle/gems/opentelemetry-api-1.2.3/lib/opentelemetry/trace.rb:70:in `with_span'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:69:in `generate_sub_spans'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:60:in `process_pipeline'
/builds/gitlab-org/release/tools/lib/release_tools/pipeline_tracer/service.rb:46:in `execute'
/builds/gitlab-org/release/tools/lib/tasks/trace.rake:27:in `block (2 levels) in <top (required)>'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/task.rb:279:in `block in execute'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/task.rb:279:in `each'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/task.rb:279:in `execute'
/usr/local/bundle/gems/sentry-ruby-5.13.0/lib/sentry/rake.rb:26:in `execute'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/task.rb:219:in `block in invoke_with_call_chain'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/task.rb:199:in `synchronize'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/task.rb:199:in `invoke_with_call_chain'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/task.rb:188:in `invoke'
/builds/gitlab-org/release/tools/Rakefile:18:in `invoke'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:182:in `invoke_task'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:138:in `block (2 levels) in top_level'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:138:in `each'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:138:in `block in top_level'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:147:in `run_with_threads'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:132:in `top_level'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:83:in `block in run'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:208:in `standard_exception_handling'
/usr/local/bundle/gems/rake-13.1.0/lib/rake/application.rb:80:in `run'
/usr/local/bundle/gems/rake-13.1.0/exe/rake:27:in `<top (required)>'
/usr/local/bundle/bin/rake:25:in `load'
/usr/local/bundle/bin/rake:25:in `<top (required)>'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/cli/exec.rb:58:in `load'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/cli/exec.rb:58:in `kernel_load'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/cli/exec.rb:23:in `run'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/cli.rb:491:in `exec'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/vendor/thor/lib/thor/invocation.rb:127:in `invoke_command'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/vendor/thor/lib/thor.rb:392:in `dispatch'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/cli.rb:34:in `dispatch'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/vendor/thor/lib/thor/base.rb:485:in `start'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/cli.rb:28:in `start'
/usr/local/bundle/gems/bundler-2.4.4/exe/bundle:45:in `block in <top (required)>'
/usr/local/bundle/gems/bundler-2.4.4/lib/bundler/friendly_errors.rb:117:in `with_friendly_errors'
/usr/local/bundle/gems/bundler-2.4.4/exe/bundle:33:in `<top (required)>'
/usr/local/bundle/bin/bundle:25:in `load'
/usr/local/bundle/bin/bundle:25:in `<main>'
2023-11-17 11:01:20.458852 E [18:SemanticLogger::Appenders] SemanticLogger::Appenders -- Failed to log to appender: SemanticLogger::Appender::SentryRuby -- Exception: NoMethodError: undefined method `set_level' for nil:NilClass
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/sentry_ruby.rb:64:in `block in log'
/usr/local/bundle/gems/sentry-ruby-5.13.0/lib/sentry-ruby.rb:366:in `with_scope'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/sentry_ruby.rb:62:in `log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:31:in `block in log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:30:in `each'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appenders.rb:30:in `log'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:152:in `process_messages'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:121:in `process'
/usr/local/bundle/gems/semantic_logger-4.15.0/lib/semantic_logger/appender/async.rb:77:in `block in thread'