Add circuit breaker for link check to improve efficiency
What problem do you want to solve?
There are cases where the link check send a large number of requests, and if an endpoint is failing, or returns a 429, then subsequent requests to the same endpoint should not be tried.
What is the proposed solution?
Implement some variant of a circuit breaker to automate the timeout, see: