Replace custom network poller with the polling crate
With https://github.com/stjepang/polling/issues/16 taken care of, I believe we should be able to replace our custom polling setup with the polling
crate. This crate also allows us to cleanly shut down the poller, as it can be woken up manually.