Support alerts on multiple metrics

As part of https://gitlab.com/gitlab-org/gitlab-ee/issues/5456 we need to figure out how to store and alert on multiple metrics.