feat: add prometheus and grafana dashboards

Description

This PR introduces Prometheus and Grafana dashboards to the Kubernetes cluster.

Supporting information

• https://prometheus-operator.dev
• https://github.com/prometheus-operator/kube-prometheus

Testing instructions

• Run ./tf plan and ./tf apply
• You will then have access to the various dashboards. To view each dashboard, run the relevant command below, then you will be able to visit https://localhost:8001 in you browser.

Prometheus

./kubectl --namespace monitoring port-forward --address 0.0.0.0 svc/prometheus-operated 8001:9090

Alert Manager

./kubectl --namespace monitoring port-forward --address 0.0.0.0 svc/alertmanager-operated 8001:9093

Grafana

./kubectl --namespace monitoring port-forward --address 0.0.0.0 svc/prometheus-operator-grafana 8001:3000

By default, we load the Workload dashboard, but there are many available by default via the Dashboards menu.

Deadline

22 April 2022