Issues are opened when a Prometheus alert clears

Problem statement

I think there is a bug in how we handle Prometheus notifying us that an alert has cleared. What I have seen is that we get two issues opened for a given alert, when it occurs and then when it clears:

We shouldn't open a new issue when an alert clears, we should ignore it until we support being able to comment and/or close the issue.