Draft: Log the scanned URLs as soon as the spiders complete

What does this MR do?

The MR relates to 209043

When the runner running DAST timeout before DAST completes, the DAST logs don't show any information about what URLs were spidered. This MR changes when the spiders URLs are logged from at the end of the scan to as soon as the AJAX spider is complete.

What are the relevant issue numbers?

Does this MR meet the acceptance criteria?

• Changelog entry added
• Documentation created/updated for GitLab EE, if necessary
• Documentation created/updated for this project, if necessary
• Documentation reviewed by technical writer or follow-up review issue created
• Tests added for this feature/bug
• Job definition updated, if necessary
  • Job definition example
  • Vendored CI Templates (also in CE)
• Conforms to the code review guidelines
• Conforms to the Go guidelines
• Security reports checked/validated by reviewer