2018-08-14: Intermittent problems with the registry fleet

Summary

From 08:43 to 9:05 we saw intermittent connectivity problems with registry, this was due to registry servers dropping out of the haproxy backend. registry-02 appears to have been dropped altogether from the registry backend.

Screen_Shot_2018-08-14_at_11.26.20_AM

https://prometheus.gprd.gitlab.net/graph?g0.range_input=1h&g0.expr=haproxy_server_up%7Benvironment%3D%22gprd%22%2C%20backend%3D%22registry%22%2Cserver%3D%22registry-02-sv-gprd%22%7D&g0.tab=0

Screen_Shot_2018-08-14_at_11.28.08_AM

Assignee Loading
Time tracking Loading