Identify Secure Jobs in a Pipeline without using a text based search

Secure jobs in a pipeline can be found using a text based search on the options field, looking for a artifacts:reports:{sast | dast | ...} entry.

See more at the issue #13662 (closed).

Text based searching for something of this nature is particularly inefficient, as the text field cannot be quickly searched. An index could be created to make this faster, however these indexes typically use a lot of memory.

Proposal

  • We revisit this issue when the ci_build_metadata_config feature flag is turned on (note: we don't know when, if ever, this will happen)
  • We may be able to create a more efficient index on the ci_builds_metadata.config_options JSON field.

Alternatively, there may arise an opportunity to create other columns on the ci_builds table that we can more efficiently query on.

/cc @sethgitlab

Assignee Loading
Time tracking Loading