The socket can't be used for anything outside anyway (that'd just be
calling for protocol errors), and this allows closing it right at abort
time.