2025-12-27T23:26:19.009428Z INFO namada_node::shell::finalize_block: Block height: 4824439, epoch: 1555, is new epoch: false, is masp new epoch: false.
2025-12-27T23:26:19.332233Z INFO namada_node::shell::finalize_block: Applied 0 transactions. Wrappers: 0, successful inner txs: 0, rejected inner txs: 0, errored inner txs: 0, unrun txs: 0, valid txs discarded by failing atomic batch: 0, vp cache size: 2 - 2, tx cache size 19 - 19
2025-12-27T23:26:19.332267Z INFO namada_node::shell::finalize_block: txs executed: 0
I[2025-12-28|00:26:19.373] executed block module=state height=4824439 num_valid_txs=0 num_invalid_txs=0
The application panicked (crashed).
Message: Encountered a storage error while committing a block: Custom(CustomError(Custom(CustomError(DBError("IO error: While open a file for appending: /opt/namada/data/9458078.sst: Too many open files")))))
Location: crates/node/src/shell/mod.rs:823
Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
2025-12-27T23:26:19.468644Z INFO namada_node::shims::abcipp_shim: ABCI response channel didn't respond
E[2025-12-28|00:26:19.468] Stopping abci.socketClient for error: read message: EOF module=abci-client connection=consensus
The application panicked (crashed).
Message: called `Result::unwrap()` on an `Err` value: RecvError(())
Location: /opt/cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tower-abci-0.19.1/src/v037/server.rs:179
Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.I[2025-12-28|00:26:19.471] service stop module=abci-client connection=consensus msg="Stopping socketClient service" impl=socketClient
Run with RUST_BACKTRACE=full to include source snippets.
E[2025-12-28|00:26:19.471] client error during proxyAppConn.CommitSync module=state err="read message: EOF"
E[2025-12-28|00:26:19.471] consensus connection terminated. Did the application crash? Please restart CometBFT module=proxy err="read message: EOF"
E[2025-12-28|00:26:19.471] CONSENSUS FAILURE!!! module=consensus err="failed to apply block; error commit failed for application: read message: EOF" stack="goroutine 483 [running]:\nruntime/debug.Stack()\n\t/opt/hostedtoolcache/go/1.24.7/x64/src/runtime/debug/stack.go:26 +0x5e\ngithub.com/cometbft/cometbft/consensus.(*State).receiveRoutine.func2()\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:737 +0x46\npanic({0xf8a880?, 0xc004a8d100?})\n\t/opt/hostedtoolcache/go/1.24.7/x64/src/runtime/panic.go:792 +0x132\ngithub.com/cometbft/cometbft/consensus.(*State).finalizeCommit(0xc000158708, 0x499d77)\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:1720 +0xec5\ngithub.com/cometbft/cometbft/consensus.(*State).tryFinalizeCommit(0xc000158708, 0x499d77)\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:1620 +0x2e5\ngithub.com/cometbft/cometbft/consensus.(*State).enterCommit.func1()\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:1555 +0x9c\ngithub.com/cometbft/cometbft/consensus.(*State).enterCommit(0xc000158708, 0x499d77, 0x0)\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:1593 +0xc0f\ngithub.com/cometbft/cometbft/consensus.(*State).addVote(0xc000158708, 0xc0014ca320, {0xc003a97c50, 0x28})\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:2233 +0x17df\ngithub.com/cometbft/cometbft/consensus.(*State).tryAddVote(0xc000158708, 0xc0014ca320, {0xc003a97c50?, 0x0?})\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:2022 +0x26\ngithub.com/cometbft/cometbft/consensus.(*State).handleMsg(0xc000158708, {{0x13c5440, 0xc005216150}, {0xc003a97c50, 0x28}})\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:866 +0x3d0\ngithub.com/cometbft/cometbft/consensus.(*State).receiveRoutine(0xc000158708, 0x0)\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:773 +0x3f1\ncreated by github.com/cometbft/cometbft/consensus.(*State).OnStart in goroutine 91\n\t/home/runner/work/cometbft/cometbft/consensus/state.go:384 +0x107\n"
I[2025-12-28|00:26:19.471] service stop module=consensus wal=/opt/namada/cometbft/data/cs.wal/wal msg="Stopping baseWAL service" impl=baseWAL
The application panicked (crashed).
Message: flush failed: DBError("IO error: While open a file for appending: /opt/namada/data/9458078.sst: Too many open files")
Location: crates/node/src/storage/rocksdb.rs:262I[2025-12-28|00:26:19.473] service stop module=consensus wal=/opt/namada/cometbft/data/cs.wal/wal msg="Stopping Group service" impl=Group
Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
I[2025-12-28|00:26:19.473] signal trapped module=main msg="captured terminated, exiting..."
I[2025-12-28|00:26:19.475] service stop module=main msg="Stopping Node service" impl=Node
I[2025-12-28|00:26:19.475] Stopping Node module=main
I[2025-12-28|00:26:19.475] service stop module=events msg="Stopping EventBus service" impl=EventBus
I[2025-12-28|00:26:19.475] service stop module=pubsub msg="Stopping PubSub service" impl=PubSub
I[2025-12-28|00:26:19.475] service stop module=txindex msg="Stopping IndexerService service" impl=IndexerService
I[2025-12-28|00:26:19.475] service stop module=p2p msg="Stopping P2P Switch service" impl="P2P Switch"
I[2025-12-28|00:26:19.475] service stop module=p2p peer=35bea1f9d7a2f34ac093ae361c6876b328d8cf20@**.**.**.**:26656 msg="Stopping MConnection service" impl=MConn{**.**.**.**:26656}
E[2025-12-28|00:26:19.476] Stopping peer for error module=p2p peer="Peer{MConn{**.**.**.**:26656} 35bea1f9d7a2f34ac093ae361c6876b328d8cf20 out}" err="read tcp **.**.**.**:43560->**.**.**.**:26656: use of closed network connection"
E[2025-12-28|00:26:19.476] error while stopping peer module=p2p error="already stopped"
I[2025-12-28|00:26:19.476] service stop module=p2p peer=35bea1f9d7a2f34ac093ae361c6876b328d8cf20@**.**.**.**:26656 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:26656} 35bea1f9d7a2f34ac093ae361c6876b328d8cf20 out}"
I[2025-12-28|00:26:19.476] service stop module=p2p peer=7b2fcfb157212fe24797153b8dc30e05285285f4@**.**.**.**:26602 msg="Stopping MConnection service" impl=MConn{**.**.**.**:26602}
E[2025-12-28|00:26:19.476] Stopping peer for error module=p2p peer="Peer{MConn{**.**.**.**:26602} 7b2fcfb157212fe24797153b8dc30e05285285f4 out}" err="read tcp **.**.**.**:58462->**.**.**.**:26602: use of closed network connection"
E[2025-12-28|00:26:19.476] error while stopping peer module=p2p error="already stopped"
I[2025-12-28|00:26:19.476] service stop module=p2p peer=7b2fcfb157212fe24797153b8dc30e05285285f4@**.**.**.**:26602 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:26602} 7b2fcfb157212fe24797153b8dc30e05285285f4 out}"
I[2025-12-28|00:26:19.476] service stop module=p2p peer=801bda27715bebc69edf8b8e26cb79d257b90932@**.**.**.**:26682 msg="Stopping MConnection service" impl=MConn{**.**.**.**:26682}
I[2025-12-28|00:26:19.476] service stop module=p2p peer=801bda27715bebc69edf8b8e26cb79d257b90932@**.**.**.**:26682 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:26682} 801bda27715bebc69edf8b8e26cb79d257b90932 out}"
I[2025-12-28|00:26:19.476] service stop module=p2p peer=b30dcb6e68f9ebac54ef6386905e71b8c95b1743@**.**.**.**:26656 msg="Stopping MConnection service" impl=MConn{**.**.**.**:26656}
I[2025-12-28|00:26:19.476] service stop module=p2p peer=b30dcb6e68f9ebac54ef6386905e71b8c95b1743@**.**.**.**:26656 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:26656} b30dcb6e68f9ebac54ef6386905e71b8c95b1743 out}"
I[2025-12-28|00:26:19.476] service stop module=p2p peer=b255fea6067e70387b11f1e246a483a81ef0451f@**.**.**.**:12356 msg="Stopping MConnection service" impl=MConn{**.**.**.**:12356}
E[2025-12-28|00:26:19.476] Stopping peer for error module=p2p peer="Peer{MConn{**.**.**.**:12356} b255fea6067e70387b11f1e246a483a81ef0451f out}" err="read tcp **.**.**.**:41672->**.**.**.**:12356: use of closed network connection"
I[2025-12-28|00:26:19.476] service stop module=p2p peer=b255fea6067e70387b11f1e246a483a81ef0451f@**.**.**.**:12356 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:12356} b255fea6067e70387b11f1e246a483a81ef0451f out}"
E[2025-12-28|00:26:19.476] error while stopping peer module=p2p error="already stopped"
I[2025-12-28|00:26:19.477] service stop module=p2p peer=2f32fc015e29e942ccefca600a8ec8bf828ba848@**.**.**.**:26656 msg="Stopping MConnection service" impl=MConn{**.**.**.**:26656}
E[2025-12-28|00:26:19.477] Stopping peer for error module=p2p peer="Peer{MConn{**.**.**.**:26656} 2f32fc015e29e942ccefca600a8ec8bf828ba848 out}" err="read tcp **.**.**.**:43732->**.**.**.**:26656: use of closed network connection"
E[2025-12-28|00:26:19.477] error while stopping peer module=p2p error="already stopped"
I[2025-12-28|00:26:19.477] service stop module=p2p peer=2f32fc015e29e942ccefca600a8ec8bf828ba848@**.**.**.**:26656 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:26656} 2f32fc015e29e942ccefca600a8ec8bf828ba848 out}"
I[2025-12-28|00:26:19.477] service stop module=p2p peer=600e85651e7d3ec695eb7c26ddf37fef5724e61b@**.**.**.**:26656 msg="Stopping MConnection service" impl=MConn{**.**.**.**:26656}
I[2025-12-28|00:26:19.477] service stop module=p2p peer=600e85651e7d3ec695eb7c26ddf37fef5724e61b@**.**.**.**:26656 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:26656} 600e85651e7d3ec695eb7c26ddf37fef5724e61b out}"
I[2025-12-28|00:26:19.477] service stop module=p2p peer=6dafbd32f6ff6bf0c53c248c430f509cd8451fda@**.**.**.**:26656 msg="Stopping MConnection service" impl=MConn{**.**.**.**:26656}
E[2025-12-28|00:26:19.477] Stopping peer for error module=p2p peer="Peer{MConn{**.**.**.**:26656} 6dafbd32f6ff6bf0c53c248c430f509cd8451fda out}" err="read tcp **.**.**.**:56122->**.**.**.**:26656: use of closed network connection"
E[2025-12-28|00:26:19.477] error while stopping peer module=p2p error="already stopped"
I[2025-12-28|00:26:19.477] service stop module=p2p peer=6dafbd32f6ff6bf0c53c248c430f509cd8451fda@**.**.**.**:26656 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:26656} 6dafbd32f6ff6bf0c53c248c430f509cd8451fda out}"
I[2025-12-28|00:26:19.477] Reconnecting to peer module=p2p addr=6dafbd32f6ff6bf0c53c248c430f509cd8451fda@**.**.**.**:26656
I[2025-12-28|00:26:19.477] service stop module=p2p peer=74184876d3b02a7d622f177779a416aa66964bdd@**.**.**.**:26656 msg="Stopping MConnection service" impl=MConn{**.**.**.**:26656}
E[2025-12-28|00:26:19.477] Stopping peer for error module=p2p peer="Peer{MConn{**.**.**.**:26656} 74184876d3b02a7d622f177779a416aa66964bdd out}" err="read tcp **.**.**.**:56952->**.**.**.**:26656: use of closed network connection"
E[2025-12-28|00:26:19.477] error while stopping peer module=p2p error="already stopped"
I[2025-12-28|00:26:19.477] Reconnecting to peer module=p2p addr=74184876d3b02a7d622f177779a416aa66964bdd@**.**.**.**:26656
I[2025-12-28|00:26:19.477] service stop module=p2p peer=74184876d3b02a7d622f177779a416aa66964bdd@**.**.**.**:26656 msg="Stopping Peer service" impl="Peer{MConn{**.**.**.**:26656} 74184876d3b02a7d622f177779a416aa66964bdd out}"
I[2025-12-28|00:26:19.477] service stop module=blockchain msg="Stopping Reactor service" impl=Reactor
E[2025-12-28|00:26:19.477] Error stopping pool module=blockchain err="already stopped"
I[2025-12-28|00:26:19.477] service stop module=consensus msg="Stopping Consensus service" impl=ConsensusReactor
I[2025-12-28|00:26:19.477] service stop module=consensus msg="Stopping State service" impl=ConsensusState
I[2025-12-28|00:26:19.477] service stop module=consensus msg="Stopping TimeoutTicker service" impl=TimeoutTicker
I[2025-12-28|00:26:19.477] service stop module=evidence msg="Stopping Evidence service" impl=Evidence
I[2025-12-28|00:26:19.477] service stop module=statesync msg="Stopping StateSync service" impl=StateSync
I[2025-12-28|00:26:19.477] service stop module=pex msg="Stopping PEX service" impl=PEX
I[2025-12-28|00:26:19.478] service stop module=p2p book=/opt/namada/cometbft/config/addrbook.json msg="Stopping AddrBook service" impl=AddrBook
I[2025-12-28|00:26:19.478] Saving AddrBook to file module=p2p book=/opt/namada/cometbft/config/addrbook.json size=1098
E[2025-12-28|00:26:19.478] Stopped accept routine, as transport is closed module=p2p numPeers=0
I[2025-12-28|00:26:19.478] Closing rpc listener module=main listener="&{Listener:0xc0005da240 sem:0xc000197880 closeOnce:{_:{} done:{_:{} v:0} m:{_:{} mu:{state:0 sema:0}}} done:0xc0001978f0}"
I[2025-12-28|00:26:19.479] RPC HTTP server stopped module=rpc-server err="accept tcp 127.0.0.1:20557: use of closed network connection"
E[2025-12-28|00:26:19.479] Error serving server module=main err="accept tcp 127.0.0.1:20557: use of closed network connection"
I[2025-12-28|00:26:19.479] Closing blockstore module=main
I[2025-12-28|00:26:19.485] Closing statestore module=main
I[2025-12-28|00:26:19.486] Closing evidencestore module=main
2025-12-27T23:26:19.520606Z INFO namada_node: Tendermint node is no longer running.
2025-12-27T23:26:19.521628Z INFO namada_node::abortable: Tendermint has exited, shutting down...
2025-12-27T23:26:19.521964Z INFO namada_node: Namada ledger node has shut down.
2025-12-27T23:26:19.521978Z INFO namada_node::broadcaster: Shutting down broadcaster...
2025-12-27T23:26:19.521989Z INFO namada_node: Broadcaster is no longer running.
2025-12-27T23:26:19.522189Z INFO namada_node: Shutting down ABCI server...
2025-12-27T23:26:19.682857Z INFO namada_node::ethereum_oracle: Ethereum event oracle is no longer running url="http://127.0.0.1:20545"
The application panicked (crashed).
Message: panic in a destructor during cleanup
Location: library/core/src/panicking.rs:226
Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
thread caused non-unwinding panic. aborting.