Disable runners in advance of failover

Spun out of this comment: #182 (comment 72315877)

We need to take good care of CI-sourced data, given runners will not hold onto it indefinitely.

Related to #182 (closed)