Tracking Secure related job executions.

We need a way to track / analyze / get notified of failures related to our jobs so that we can be quick in resolving the issues rather than waiting for complaints from users.

I am not too familiar with the alerting/tracking infrastructure of GitLab, so not really sure how to go about implementing this one in a proper manner.

For a start, I am listing down things which we can start to track (please add more). If something from the following is already being captured, please add that information next to it:

• Count of job executions (Proxy: Number of times the docker image got downloaded ?)
• Exit codes of jobs
• Failures during Docker pull
• Failures in individual scanner/tool
• Timeouts in job

We should be able to bucket these errors according to the sub-group (DAST, SAST, Container Scanning, Dependency Scanning)