Identify Secure Jobs in a Pipeline without using a text based search
Secure jobs in a pipeline can be found using a text based search on the options field, looking for a artifacts:reports:{sast | dast | ...} entry.
See more at the issue #13662 (closed).
Text based searching for something of this nature is particularly inefficient, as the text field cannot be quickly searched. An index could be created to make this faster, however these indexes typically use a lot of memory.
Proposal
- We revisit this issue when the
ci_build_metadata_configfeature flag is turned on (note: we don't know when, if ever, this will happen) - We may be able to create a more efficient index on the
ci_builds_metadata.config_optionsJSON field.
Alternatively, there may arise an opportunity to create other columns on the ci_builds table that we can more efficiently query on.
/cc @sethgitlab