Skip to content

SE-3310 Ensure prod instances email urgent on monitoring fail and alerts auto close once resolved

Ghost User requested to merge samuel/monitoring-emails into master

Otherwise we only get paged on a provision failure; ping monitoring previously would only email the settings.ADMINS emails.

Test instructions:

  • register a new account, choose instance settings, and confirm your email
  • view the settings of the new instance
  • verify that additional_monitoring_emails has the PROD_APPSERVER_FAIL_EMAILS added
  • verify that the corresponding newrelic alert policy for the new instance has ADMINS and PROD_APPSERVER_FAIL_EMAILS set in the notification channels
  • do something to take the instance offline (change the dns records, stop the lms service, etc.)
  • verify that newrelic alerts open
  • put the instance back online
  • verify the newrelic alerts/incidents auto close after a few minutes.

Reviewers:

Merge request reports