Investigate "Prometheus has slow rule evaluations" alerts

This is being rather noisy, e.g. production#3365 (closed).

Note that this alert might have been noisy (and ignored) for a long time, and we've only just configured it to open issues.

@brentnewton @AnthonySandoval for triage.