Validate microservice restarts after a crash

Scenarios to validate:

  • Restart each microservice, when it is processing a request (except rsync, which is known to be good)
  • In particular: Restart orchestrator when a DIG instantiate request is in flight
  • Restart all microservices together
  • Restart the node on which EMCO pods are running (assuming it is 1 node for now)

See the Recovery from crashes/disruptions section in the EMCO-in-production wiki page.