I'm trying to get our tezos-node going again, but no matter what I do it seems to fail on block 1195254. Rebooting and upgrading the node haven't fixed the issue. Do I need to roll back a few blocks and try syncing from there, is there a method to do that?
I originally noticed the error on node version 06398944 (2020-02-11 14:29:14 +0100) but upgraded to the latest opam version but received the same error:
./tezos-node --version
e69b63f1 (2020-09-04 13:28:39 +0200) (7.4)
Nov 2 04:04:58 - block_validator_process_external: Block validator started on pid 3752069
Nov 2 04:04:58 - node.validator.bootstrap_pipeline: unexpected error while fetching headers
Nov 2 04:04:58 - validator.peer: Worker crashed [node_peer_validator]:
Nov 2 04:04:58 - validator.peer: End_of_file
Nov 2 04:05:00 - validator.block: Validation of block BL3xFTUPQ1tMC4nTFxUAodNcWL6ppvRomzGwsJ18ozchAhsLPPE failed
Nov 2 04:05:00 - validator.block: Request pushed on 2020-11-02T04:04:54-00:00, treated in 4.768s, completed in 1.397s ,
Nov 2 04:05:00 - validator.block: (Invalid_argument "Json_encoding.construct: consequence of bad union")
Nov 2 04:05:00 - block_validator_process_external: The process terminated abnormally with value 1
Nov 2 04:05:00 - node.validator.bootstrap_pipeline: unexpected error while fetching headers
Nov 2 04:05:00 - block_validator_process_external: Block validator started on pid 3752074
Nov 2 04:05:00 - validator.peer: Worker crashed [node_peer_validator]:
Nov 2 04:05:00 - validator.peer: (Invalid_argument "Json_encoding.construct: consequence of bad union")
No blocks are rejected:
./tezos-admin-client list rejected blocks
No invalid blocks.
I can't use the client to pull the block (1195254), though the previous block (1195253) returns via this command:
./tezos-client rpc get /chains/main/blocks/BL3xFTUPQ1tMC4nTFxUAodNcWL6ppvRomzGwsJ18ozchAhsLPPE/header
Error:
Did not find service: GET http://localhost:8732/describe/chains/main/blocks/BL3xFTUPQ1tMC4nTFxUAodNcWL6ppvRomzGwsJ18ozchAhsLPPE/header?recurse=no