Remove the need to download knapsack report from gcs bucket

What does this MR do and why?

Refactor knapsack setup to use runtime data stored in repository for knapsack report creation.

This change removes following:

• Separate jobs that download knapsack report before tests get executed
• Specific selective report creation as it's not needed, main report has all the runtime data necessary for knapsack (knapsack report doesn't have to contain exactly the same tests that would be executed, it just needs to contain the necessary specs but it can contain all the extra specs as well)
• Uploading knapsack report itself

Added features:

• Create "knapsack" report before test run based on example runtimes and take in to account which examples are skipped dynamically to correctly resemble runtime (if a test is quarantined, knapsack needs to have the information it will take miliseconds to run and distribute tests accordingly)
• Upload updated runtime data for each example on every master execution

Closes Simplify knapsack setup (gitlab-org/quality/analytics/team#5 - closed)

References

Please include cross links to any resources that are relevant to this MR. This will give reviewers and future readers helpful context to give an efficient review of the changes introduced.

• [E2E] Build capability to dynamically scale amo... (gitlab-org/quality/analytics/team#2 - closed)

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

qa/qa/specs/knapsack_runner.rb

@@ -3,26 +3,44 @@
 module QA
   module Specs
     class KnapsackRunner
-      def self.run(args, parallel: false)
-        QA::Support::KnapsackReport.configure!
+      class << self
+        def run(args, rspec_tags:, parallel: false)
+          knapsack_reporter = Support::KnapsackReport.new
+          knapsack_reporter.configure!
+          knapsack_reporter.create_local_report!(executable_example_ids(rspec_tags))
 
-        allocator = Knapsack::AllocatorBuilder.new(Knapsack::Adapters::RSpecAdapter).allocator
+          allocator = Knapsack::AllocatorBuilder.new(Knapsack::Adapters::RSpecAdapter).allocator
 
-        Knapsack.logger.info '==== Knapsack specs to execute ====='
-        Knapsack.logger.info 'Report specs:'
-        Knapsack.logger.info allocator.report_node_tests
-        Knapsack.logger.info 'Leftover specs:'
-        Knapsack.logger.info allocator.leftover_node_tests
+          Knapsack.logger.info '==== Knapsack specs to execute ====='
+          Knapsack.logger.info 'Report specs:'
+          Knapsack.logger.info allocator.report_node_tests
+          Knapsack.logger.info 'Leftover specs:'
+          Knapsack.logger.info allocator.leftover_node_tests
 
-        if parallel
-          rspec_args = args.reject { |arg| arg == "--" || arg.start_with?("qa/specs/features") }
-          run_args = [*rspec_args, '--', *allocator.node_tests]
-          return ParallelRunner.run(run_args)
+          if parallel
+            rspec_args = args.reject { |arg| arg == "--" || arg.start_with?("qa/specs/features") }
+            run_args = [*rspec_args, '--', *allocator.node_tests]
+            return ParallelRunner.run(run_args)
+          end
+
+          status = RSpec::Core::Runner.run([*args, '--', *allocator.node_tests])
+          yield status if block_given?
+          status
         end
 
-        status = RSpec::Core::Runner.run([*args, '--', *allocator.node_tests])
-        yield status if block_given?
-        status
+        private
+
+        # Example ids that are not skipped by dynamic conditions
+        #
+        # @param rspec_tags [Array<String>]
+        # @return [Array<String>]
+        def executable_example_ids(rspec_tags)
+          Support::ExampleData.fetch(rspec_tags).each_with_object([]) do |example, ids|
+            next unless example[:status] == "passed"
+
+            ids << example[:id]
+          end
+        end
       end
     end
   end