Implement monitoring for Distribution runners

We currently have no observability or monitoring regarding the runners used by Distribution teams. We should implement this.