Detect comments in custom Prometheus queries and strip them

Prometheus can support comments in Prometheus queries, where # denotes a comment until the end of the line.

This can cause problems with our alerting, since we use the base query and don't expect comments. To solve this, we should strip any comments out of the queries users set.