Move Agent CI tunnel functionality to Core

What does this MR do and why?

Part of moving Agents to Core (&6290 (closed)).

Moves the job/allowed_agents API endpoint and associated finders to Core, removing license checks where needed.

Screenshots or screen recordings

These are strongly recommended to assist reviewers and reduce the time to merge your change.

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

• I have evaluated the MR acceptance checklist for this MR.

#340357 (closed)