tezos-baker-003-PsddFKi3 gridlocks when baking with multiple keys and 1 key happens to be a remote signed that is unavailable
This is a private chain I run with a custom dictator: $ git rev-parse HEAD d1942e9ef74feffad3e9befa1250ebe8e3f43571
I have a number of keys in the client - 5 of them are local to the box, 1 is a remote signer that happens to be down:
$ tezos-baker-003-PsddFKi3 run with local node ~/.tezos-node/ --max-priority 20 Enter password for encrypted key "test": Waiting for the node to be synchronized with its peers... Node synchronized. Baker started. Apr 1 17:47:47 - client.scheduling: Setting up before the baker can start. Apr 1 17:47:47 - client.nonce_revelation: Nothing to reveal for block BLEt7N1idDpq Apr 1 17:47:47 - client.baking: New baking slot found (level 1222, priority 0) at 2019-04-01T17:46:27Z for b1 after BLEt7N1idDpq. Apr 1 17:47:47 - client.scheduling: Starting baker daemon Apr 1 17:47:47 - client.scheduling: Waking up for baker. Apr 1 17:47:47 - client.baking: Try baking after BLEt7N1idDpq (slot 0) for b1 (2019-04-01T17:46:27Z) Apr 1 17:47:47 - client.baking: No endorsements present in the mempool. Waiting until 2019-04-01T17:46:29Z (0s) for new operations. Apr 1 17:47:47 - client.baking: Starting client-side validation BLEt7N1idDpq Apr 1 17:47:47 - client.baking: Try forging locally the block header for BLEt7N1idDpq (slot 0) for b1 (2019-04-01T17:46:27Z) Apr 1 17:47:47 - client.baking: Injecting block (priority 0, fitness 00::00000000000009bc) for b1 after BLEt7N1idDpq... Apr 1 17:47:49 - client.baking: Injected block BM7iNekpW62p for b1 after BLEt7N1idDpq (level 1222, priority 0, fitness 00::00000000000009bc, operations 0+0+0+0). Apr 1 17:47:49 - client.nonce_revelation: Nothing to reveal for block BM7iNekpW62p Apr 1 17:47:49 - client.baking: New baking slot found (level 1223, priority 0) at 2019-04-01T17:46:42Z for b3 after BM7iNekpW62p. Apr 1 17:47:49 - client.scheduling: Waking up for baker. Apr 1 17:47:49 - client.baking: Try baking after BM7iNekpW62p (slot 0) for b3 (2019-04-01T17:46:42Z) Apr 1 17:47:49 - client.baking: No endorsements present in the mempool. Waiting until 2019-04-01T17:46:44Z (0s) for new operations. Apr 1 17:47:49 - client.baking: Starting client-side validation BM7iNekpW62p Apr 1 17:47:49 - client.baking: Try forging locally the block header for BM7iNekpW62p (slot 0) for b3 (2019-04-01T17:46:42Z) Apr 1 17:47:49 - client.baking: Injecting block (priority 0, fitness 00::00000000000009bd) for b3 after BM7iNekpW62p... Apr 1 17:47:50 - client.baking: Injected block BLSfSc3TRmhm for b3 after BM7iNekpW62p (level 1223, priority 0, fitness 00::00000000000009bd, operations 0+0+0+0). Apr 1 17:47:50 - client.nonce_revelation: Nothing to reveal for block BLSfSc3TRmhm Apr 1 17:47:50 - client.baking: New baking slot found (level 1224, priority 0) at 2019-04-01T17:46:57Z for b1 after BLSfSc3TRmhm. Apr 1 17:47:50 - client.scheduling: Waking up for baker. Apr 1 17:47:50 - client.baking: Try baking after BLSfSc3TRmhm (slot 0) for b1 (2019-04-01T17:46:57Z) Apr 1 17:47:50 - client.baking: No endorsements present in the mempool. Waiting until 2019-04-01T17:46:59Z (0s) for new operations. Apr 1 17:47:50 - client.baking: Starting client-side validation BLSfSc3TRmhm Apr 1 17:47:50 - client.baking: Try forging locally the block header for BLSfSc3TRmhm (slot 0) for b1 (2019-04-01T17:46:57Z) Apr 1 17:47:50 - client.baking: Injecting block (priority 0, fitness 00::00000000000009be) for b1 after BLSfSc3TRmhm... Apr 1 17:47:52 - client.baking: Injected block BLGZYeSk1ajp for b1 after BLSfSc3TRmhm (level 1224, priority 0, fitness 00::00000000000009be, operations 0+0+0+0). Apr 1 17:47:52 - client.nonce_revelation: Nothing to reveal for block BLGZYeSk1ajp Apr 1 17:47:52 - client.baking: New baking slot found (level 1225, priority 0) at 2019-04-01T17:47:12Z for b4 after BLGZYeSk1ajp. Apr 1 17:47:52 - client.scheduling: Waking up for baker. Apr 1 17:47:52 - client.baking: Try baking after BLGZYeSk1ajp (slot 0) for b4 (2019-04-01T17:47:12Z) Apr 1 17:47:52 - client.baking: No endorsements present in the mempool. Waiting until 2019-04-01T17:47:14Z (0s) for new operations. Apr 1 17:47:52 - client.baking: Starting client-side validation BLGZYeSk1ajp Apr 1 17:47:52 - client.baking: Try forging locally the block header for BLGZYeSk1ajp (slot 0) for b4 (2019-04-01T17:47:12Z) Apr 1 17:47:52 - client.baking: Injecting block (priority 0, fitness 00::00000000000009bf) for b4 after BLGZYeSk1ajp... Apr 1 17:47:54 - client.baking: Injected block BKmisN31RkHS for b4 after BLGZYeSk1ajp (level 1225, priority 0, fitness 00::00000000000009bf, operations 0+0+0+0). Apr 1 17:47:54 - client.nonce_revelation: Nothing to reveal for block BKmisN31RkHS Apr 1 17:47:54 - client.baking: New baking slot found (level 1226, priority 0) at 2019-04-01T17:47:27Z for azure after BKmisN31RkHS. Apr 1 17:47:54 - client.scheduling: Waking up for baker. Apr 1 17:47:54 - client.baking: Try baking after BKmisN31RkHS (slot 0) for azure (2019-04-01T17:47:27Z) Apr 1 17:47:54 - client.baking: No endorsements present in the mempool. Waiting until 2019-04-01T17:47:29Z (0s) for new operations. Apr 1 17:47:54 - client.baking: Starting client-side validation BKmisN31RkHS Apr 1 17:47:54 - client.baking: Try forging locally the block header for BKmisN31RkHS (slot 0) for azure (2019-04-01T17:47:27Z) Apr 1 17:47:54 - client.baking: Injecting block (priority 0, fitness 00::00000000000009c0) for azure after BKmisN31RkHS... Apr 1 17:47:54 - client.baking: Error while injecting block Apr 1 17:47:54 - client.baking: Included operations : Apr 1 17:47:54 - client.baking: Error: Apr 1 17:47:54 - client.baking: Rpc request failed: Apr 1 17:47:54 - client.baking: - meth: GET Apr 1 17:47:54 - client.baking: - uri: http://127.0.0.1:5001/authorized_keys Apr 1 17:47:54 - client.baking: - error: Unable to connect to the node: "Connection refused" Apr 1 17:47:54 - client.baking: