Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run mainnet guardian nodes,the ledger crashes #150

Open
houlei1017 opened this issue Jul 7, 2021 · 0 comments
Open

Run mainnet guardian nodes,the ledger crashes #150

houlei1017 opened this issue Jul 7, 2021 · 0 comments

Comments

@houlei1017
Copy link

I run in docker. 4 cores 8G memory, After the error, delete the data and run again, the error is still exploded

[2021-07-07 07:29:47] INFO [consensus] Finalizing block block.Hash=0x5c0fbda53cb177422d78055cdaee47ba8c6a884686384acd39aafa87d9f924c4 block.Height=11051767
[2021-07-07 07:29:47] INFO [consensus] Notified finalized block, height=11051767
[2021-07-07 07:29:47] INFO [rpc] Processing finalized block, height=11051767
[2021-07-07 07:29:47] INFO [rpc] Done processing finalized block, height=11051767
[2021-07-07 07:29:48] INFO [consensus] Finalizing block block.Hash=0x3ac7a7a0ba15c91ac5860fad1f860ab5e288a3461c08a2d035fe1fcd0d8f2f26 block.Height=11051768
[2021-07-07 07:29:48] INFO [consensus] Notified finalized block, height=11051768
[2021-07-07 07:29:48] INFO [rpc] Processing finalized block, height=11051768
[2021-07-07 07:29:48] INFO [rpc] Done processing finalized block, height=11051768
fatal: morestack on g0
SIGTRAP: trace trap
PC=0x4933a2 m=11 sigcode=128

goroutine 0 [idle]:
runtime.abort()
/usr/local/go/src/runtime/asm_amd64.s:854 +0x2
runtime.morestack()
/usr/local/go/src/runtime/asm_amd64.s:425 +0x25

goroutine 121 [syscall]:
runtime.cgocall(0xf1ce60, 0xc0712f7e48, 0xa90b454ed1ff3ea0)
/usr/local/go/src/runtime/cgocall.go:154 +0x5b fp=0xc0712f7e18 sp=0xc0712f7de0 pc=0x42499b
github.com/herumi/bls-eth-go-binary/bls._Cfunc_blsVerifyPop(0xc0e0a76fc0, 0xc0e0fbd9e0, 0xb89d695a00000000)
_cgo_gotypes.go:990 +0x45 fp=0xc0712f7e48 sp=0xc0712f7e18 pc=0x8e9025
github.com/herumi/bls-eth-go-binary/bls.(*Sign).VerifyPop(...)
/go/pkg/mod/github.com/herumi/[email protected]/bls/bls.go:567
github.com/thetatoken/theta/crypto/bls.(*Signature).PopVerify(0xc127f0c2d0, 0xc127f0c2c0, 0x60)
/go/theta-protocol-ledger/crypto/bls/bls.go:102 +0x55 fp=0xc0712f7e70 sp=0xc0712f7e48 pc=0x8ee335
github.com/thetatoken/theta/ledger/execution.(*DepositStakeExecutor).checkBLSSummary(0xc12fc6a0c0, 0xc0e9046240, 0x37d2f2f9a90b454e, 0xc0b89d695a, 0x0, 0xc0ec95fd60)
/go/theta-protocol-ledger/ledger/execution/tx_deposit_stake.go:238 +0x1b1 fp=0xc0712f7f28 sp=0xc0712f7e70 pc=0xbfaf11
github.com/thetatoken/theta/ledger/execution.(*DepositStakeExecutor).process(0xc12fc6a0c0, 0xc0109cdf57, 0x7, 0xc01ea80190, 0x15618e8, 0xc0e9046240, 0x0, 0x0, 0x0, 0x0, ...)
/go/theta-protocol-ledger/ledger/execution/tx_deposit_stake.go:191 +0x6c5 fp=0xc0712f8168 sp=0xc0712f7f28 pc=0xbfa425
github.com/thetatoken/theta/ledger/execution.(*Executor).process(0xc12fc7a0a0, 0xc0109cdf57, 0x7, 0xc01ea80190, 0x15618e8, 0xc0e9046240, 0x0, 0x0, 0x0, 0x0, ...)
/go/theta-protocol-ledger/ledger/execution/executor.go:160 +0x1e7 fp=0xc0712f8278 sp=0xc0712f8168 pc=0xbf1b07
github.com/thetatoken/theta/ledger/execution.(*Executor).processTx(0xc12fc7a0a0, 0x15618e8, 0xc0e9046240, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/go/theta-protocol-ledger/ledger/execution/executor.go:126 +0x177 fp=0xc0712f8350 sp=0xc0712f8278 pc=0xbf1577
github.com/thetatoken/theta/ledger/execution.(*Executor).ExecuteTx(...)
/go/theta-protocol-ledger/ledger/execution/executor.go:84
github.com/thetatoken/theta/ledger.(*Ledger).ApplyBlockTxs(0xc12fc708a0, 0xc0e05f38a0, 0x0, 0x0, 0x0, 0x0)
/go/theta-protocol-ledger/ledger/ledger.go:339 +0x407 fp=0xc0712f8808 sp=0xc0712f8350 pc=0xc0f667
github.com/thetatoken/theta/consensus.(*ConsensusEngine).handleNormalBlock(0xc11beb8000, 0xc0aca0cb40)
/go/theta-protocol-ledger/consensus/engine.go:752 +0x652 fp=0xc0712f9530 sp=0xc0712f8808 pc=0xba1b32
github.com/thetatoken/theta/consensus.(*ConsensusEngine).handleBlock(0xc11beb8000, 0xc0d29cd680)
/go/theta-protocol-ledger/consensus/engine.go:643 +0x158 fp=0xc0712f9718 sp=0xc0712f9530 pc=0xba0378
github.com/thetatoken/theta/consensus.(*ConsensusEngine).processMessage(0xc11beb8000, 0x118b8c0, 0xc0d29cd680, 0x0)
/go/theta-protocol-ledger/consensus/engine.go:335 +0x2f6 fp=0xc0712f9af8 sp=0xc0712f9718 pc=0xb998d6
github.com/thetatoken/theta/consensus.(*ConsensusEngine).mainLoop(0xc11beb8000)
/go/theta-protocol-ledger/consensus/engine.go:265 +0x1b1 fp=0xc0712f9fd8 sp=0xc0712f9af8 pc=0xb98db1
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1371 +0x1 fp=0xc0712f9fe0 sp=0xc0712f9fd8 pc=0x4935a1
created by github.com/thetatoken/theta/consensus.(*ConsensusEngine).Start
/go/theta-protocol-ledger/consensus/engine.go:156 +0x1f0

goroutine 1 [chan receive]:
github.com/thetatoken/theta/cmd/theta/cmd.runStart(0x1b43100, 0xc0002a18c0, 0x0, 0x2)
/go/theta-protocol-ledger/cmd/theta/cmd/start.go:179 +0x836
github.com/spf13/cobra.(*Command).execute(0x1b43100, 0xc0002a1860, 0x2, 0x2, 0x1b43100, 0xc0002a1860)
/go/pkg/mod/github.com/spf13/[email protected]/command.go:830 +0x2c2
github.com/spf13/cobra.(*Command).ExecuteC(0x1b42e80, 0xc000000180, 0x200000003, 0xc000000180)
/go/pkg/mod/github.com/spf13/[email protected]/command.go:914 +0x30b
github.com/spf13/cobra.(*Command).Execute(...)
/go/pkg/mod/github.com/spf13/[email protected]/command.go:864
github.com/thetatoken/theta/cmd/theta/cmd.Execute()
/go/theta-protocol-ledger/cmd/theta/cmd/root.go:33 +0x31
main.main()
/go/theta-protocol-ledger/cmd/theta/main.go:6 +0x25

goroutine 18 [select, 45 minutes]:
github.com/ipfs/go-log/writer.(*MirrorWriter).logRoutine(0xc000195500)
/go/pkg/mod/github.com/ipfs/[email protected]/writer/writer.go:76 +0x106
created by github.com/ipfs/go-log/writer.NewMirrorWriter
/go/pkg/mod/github.com/ipfs/[email protected]/writer/writer.go:41 +0xb9

goroutine 19 [select]:
go.opencensus.io/stats/view.(*worker).start(0xc0002b2690)
/go/pkg/mod/[email protected]/stats/view/worker.go:154 +0xcd
created by go.opencensus.io/stats/view.init.0
/go/pkg/mod/[email protected]/stats/view/worker.go:32 +0x57

goroutine 10 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc0002561c0)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:206 +0x105
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:237 +0x18c

goroutine 36 [runnable]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc00032e340)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:90 +0xb1
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:142 +0x429

goroutine 37 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc00032e340)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_state.go:101 +0xd7
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:143 +0x44b

goroutine 38 [runnable]:
syscall.Syscall(0x107, 0xffffffffffffff9c, 0xc0e8ac8ea0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/syscall/asm_linux_amd64.s:20 +0x5
syscall.unlinkat(0xffffffffffffff9c, 0xc0e8ac8e70, 0x2b, 0x0, 0x2b, 0xc0e8ac8e70)
/usr/local/go/src/syscall/zsyscall_linux_amd64.go:126 +0xac
syscall.Unlink(...)
/usr/local/go/src/syscall/syscall_linux.go:182
os.Remove.func1(...)
/usr/local/go/src/os/file_unix.go:300
os.ignoringEINTR(...)
/usr/local/go/src/os/file_posix.go:245
os.Remove(0xc0e8ac8e70, 0x2b, 0x2, 0xc0e8ac8e70)
/usr/local/go/src/os/file_unix.go:299 +0x4d
github.com/syndtr/goleveldb/leveldb/storage.(*fileStorage).Remove(0xc0001c6070, 0x4, 0x1668, 0x0, 0x0)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/storage/file_storage.go:525 +0x166
github.com/syndtr/goleveldb/leveldb.(*tOps).remove.func1()
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/table.go:421 +0x6a
github.com/syndtr/goleveldb/leveldb/cache.(*Cache).Delete(0xc0002a44c0, 0x0, 0x1668, 0xc0e8af83a8, 0xc0001c6000)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/cache/cache.go:449 +0x306
github.com/syndtr/goleveldb/leveldb.(*tOps).remove(0xc0003b37a0, 0xc05bf17900)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/table.go:420 +0x7f
github.com/syndtr/goleveldb/leveldb.(*version).releaseNB(0xc0438b7a40)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/version.go:73 +0xec
github.com/syndtr/goleveldb/leveldb.(*version).release(0xc0438b7a40)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/version.go:83 +0x48
github.com/syndtr/goleveldb/leveldb.(*compaction).release(0xc0b99ed700)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/session_compaction.go:169 +0x49
github.com/syndtr/goleveldb/leveldb.(*DB).tableCompaction(0xc00032e340, 0xc0b99ed700, 0x138df00)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:591 +0x93c
github.com/syndtr/goleveldb/leveldb.(*DB).tableAutoCompaction(0xc00032e340)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:633 +0x54
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc00032e340)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:852 +0x2cf
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:149 +0x5a5

goroutine 39 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc00032e340)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:762 +0x125
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:150 +0x5c7

goroutine 40 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc00015e0e0)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:206 +0x105
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:237 +0x18c

goroutine 41 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc00032eb60)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:90 +0xb1
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:142 +0x429

goroutine 42 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc00032eb60)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_state.go:101 +0xd7
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:143 +0x44b

goroutine 43 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc00032eb60)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:825 +0x228
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:149 +0x5a5

goroutine 44 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc00032eb60)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:762 +0x125
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:150 +0x5c7

goroutine 45 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc00015e2a0)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:206 +0x105
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:237 +0x18c

goroutine 46 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc00032ed00)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:90 +0xb1
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:142 +0x429

goroutine 47 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc00032ed00)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_state.go:101 +0xd7
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:143 +0x44b

goroutine 48 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc00032ed00)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:825 +0x228
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:149 +0x5a5

goroutine 49 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc00032ed00)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:762 +0x125
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:150 +0x5c7

goroutine 66 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc00015e460)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:206 +0x105
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:237 +0x18c

goroutine 11 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc00032eea0)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:90 +0xb1
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:142 +0x429

goroutine 12 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc00032eea0)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_state.go:101 +0xd7
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:143 +0x44b

goroutine 13 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc00032eea0)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:825 +0x228
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:149 +0x5a5

goroutine 14 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc00032eea0)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:762 +0x125
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:150 +0x5c7

goroutine 186 [select]:
github.com/thetatoken/theta/p2p/connection.(*Connection).sendRoutine(0xc0b4dca420)
/go/theta-protocol-ledger/p2p/connection/connection.go:308 +0x1dd
created by github.com/thetatoken/theta/p2p/connection.(*Connection).Start
/go/theta-protocol-ledger/p2p/connection/connection.go:187 +0xa7

goroutine 173 [select]:
github.com/thetatoken/theta/common/timer.(*RepeatTimer).fireRoutine(0xc0002a5480, 0xc047d852c0)
/go/theta-protocol-ledger/common/timer/repeat_timer.go:42 +0xe7
created by github.com/thetatoken/theta/common/timer.NewRepeatTimer
/go/theta-protocol-ledger/common/timer/repeat_timer.go:36 +0x145

goroutine 62 [select]:
github.com/thetatoken/theta/p2p/connection.(*Connection).sendRoutine(0xc0b24d4000)
/go/theta-protocol-ledger/p2p/connection/connection.go:308 +0x1dd
created by github.com/thetatoken/theta/p2p/connection.(*Connection).Start
/go/theta-protocol-ledger/p2p/connection/connection.go:187 +0xa7

goroutine 28 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc00015ea80)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:206 +0x105
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/util/buffer_pool.go:237 +0x18c

goroutine 29 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc01a039860)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:90 +0xb1
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:142 +0x429

goroutine 30 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc01a039860)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_state.go:101 +0xd7
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:143 +0x44b

goroutine 31 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc01a039860)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:825 +0x228
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:149 +0x5a5

goroutine 32 [select, 23 minutes]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc01a039860)
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db_compaction.go:762 +0x125
created by github.com/syndtr/goleveldb/leveldb.openDB
/go/pkg/mod/github.com/syndtr/[email protected]/leveldb/db.go:150 +0x5c7

goroutine 109 [select]:
github.com/thetatoken/theta/common/timer.(*RepeatTimer).fireRoutine(0xc101990800, 0xc0a86ab0e0)
/go/theta-protocol-ledger/common/timer/repeat_timer.go:42 +0xe7
created by github.com/thetatoken/theta/common/timer.NewRepeatTimer
/go/theta-protocol-ledger/common/timer/repeat_timer.go:36 +0x145

goroutine 179 [select]:
github.com/thetatoken/theta/common/timer.(*RepeatTimer).fireRoutine(0xc119a940c0, 0xc0f5ab6140)
/go/theta-protocol-ledger/common/timer/repeat_timer.go:42 +0xe7
created by github.com/thetatoken/theta/common/timer.NewRepeatTimer
/go/theta-protocol-ledger/common/timer/repeat_timer.go:36 +0x145

goroutine 117 [syscall]:
os/signal.signal_recv(0x100)
/usr/local/go/src/runtime/sigqueue.go:168 +0xa5
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:23 +0x25
created by os/signal.Notify.func1.1
/usr/local/go/src/os/signal/signal.go:151 +0x45

goroutine 118 [chan receive]:
github.com/thetatoken/theta/cmd/theta/cmd.runStart.func2(0xc06f0be840, 0xc11b756480, 0x0, 0xc0177921e0)
/go/theta-protocol-ledger/cmd/theta/cmd/start.go:153 +0x38
created by github.com/thetatoken/theta/cmd/theta/cmd.runStart
/go/theta-protocol-ledger/cmd/theta/cmd/start.go:152 +0x75f

goroutine 119 [select]:
github.com/thetatoken/theta/consensus.(*GuardianEngine).mainLoop(0xc000034240, 0x156d058, 0xc0002a4200)
/go/theta-protocol-ledger/consensus/guardian.go:121 +0xa5
created by github.com/thetatoken/theta/consensus.(*GuardianEngine).Start
/go/theta-protocol-ledger/consensus/guardian.go:116 +0x53

goroutine 120 [select]:
github.com/thetatoken/theta/consensus.(*EliteEdgeNodeEngine).mainLoop(0xc0000342d0, 0x156d058, 0xc0002a4200)
/go/theta-protocol-ledger/consensus/elite_edge_node.go:132 +0xd6
created by github.com/thetatoken/theta/consensus.(*EliteEdgeNodeEngine).Start
/go/theta-protocol-ledger/consensus/elite_edge_node.go:127 +0x53

goroutine 122 [select]:
github.com/thetatoken/theta/netsync.(*RequestManager).mainLoop(0xc08eeaa240)
/go/theta-protocol-ledger/netsync/request.go:193 +0xe5
created by github.com/thetatoken/theta/netsync.(*RequestManager).Start
/go/theta-protocol-ledger/netsync/request.go:209 +0x9e

goroutine 123 [select]:
github.com/thetatoken/theta/netsync.(*RequestManager).passReadyBlocks(0xc08eeaa240)
/go/theta-protocol-ledger/netsync/request.go:775 +0x592
created by github.com/thetatoken/theta/netsync.(*RequestManager).Start
/go/theta-protocol-ledger/netsync/request.go:212 +0xdb

goroutine 124 [select]:
github.com/thetatoken/theta/netsync.(*SyncManager).mainLoop(0xc12fc7e090)
/go/theta-protocol-ledger/netsync/sync.go:122 +0x15b
created by github.com/thetatoken/theta/netsync.(*SyncManager).Start
/go/theta-protocol-ledger/netsync/sync.go:106 +0xb6

goroutine 213 [select]:
github.com/thetatoken/theta/common/timer.(*RepeatTimer).fireRoutine(0xc1099acbc0, 0xc0c9fb8d70)
/go/theta-protocol-ledger/common/timer/repeat_timer.go:42 +0xe7
created by github.com/thetatoken/theta/common/timer.NewRepeatTimer
/go/theta-protocol-ledger/common/timer/repeat_timer.go:36 +0x145

goroutine 210 [IO wait]:
internal/poll.runtime_pollWait(0x7f41400ce038, 0x72, 0xffffffffffffffff)
/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc0ad84eb98, 0x72, 0x1000, 0x1000, 0xffffffffffffffff)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc0ad84eb80, 0xc05cac3000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_unix.go:166 +0x1d5
net.(*netFD).Read(0xc0ad84eb80, 0xc05cac3000, 0x1000, 0x1000, 0x0, 0x0, 0xc12fc70358)
/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc127f88260, 0xc05cac3000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:183 +0x91
bufio.(*Reader).Read(0xc01f160e40, 0xc0d9070820, 0x20, 0x20, 0x42b83f, 0xc000020000, 0x10cb7c0)
/usr/local/go/src/bufio/bufio.go:227 +0x222
io.ReadAtLeast(0x7f412916e7c8, 0xc01decc500, 0xc0d9070820, 0x20, 0x20, 0x20, 0x4b761f, 0xc00026ae50, 0xaa5)
/usr/local/go/src/io/io.go:328 +0x87
io.ReadFull(...)
/usr/local/go/src/io/io.go:347
github.com/thetatoken/theta/p2p/connection.(*rlpxFrameRW).ReadPacket(0xc131a942a0, 0xca9875, 0x27a482a5700, 0x2a)
/go/theta-protocol-ledger/p2p/connection/auth.go:549 +0xc7
github.com/thetatoken/theta/p2p/connection.(*Connection).readPacket(0xc0b4dca2c0, 0x0, 0x0, 0x0)
/go/theta-protocol-ledger/p2p/connection/connection.go:390 +0x98
github.com/thetatoken/theta/p2p/connection.(*Connection).recvRoutine(0xc0b4dca2c0)
/go/theta-protocol-ledger/p2p/connection/connection.go:421 +0xdc
created by github.com/thetatoken/theta/p2p/connection.(*Connection).Start
/go/theta-protocol-ledger/p2p/connection/connection.go:188 +0xc9

goroutine 217 [select]:
github.com/thetatoken/theta/common/timer.(*RepeatTimer).fireRoutine(0xc1099accc0, 0xc0c9fb8ff0)
/go/theta-protocol-ledger/common/timer/repeat_timer.go:42 +0xe7
created by github.com/thetatoken/theta/common/timer.NewRepeatTimer
/go/theta-protocol-ledger/common/timer/repeat_timer.go:36 +0x145

goroutine 164 [chan receive]:
github.com/thetatoken/theta/p2p/messenger.(*SeedPeerConnector).maintainConnectivityRoutine(0xc11b1f7830)
/go/theta-protocol-ledger/p2p/messenger/disc_seed_peer_connector.go:156 +0x5d
created by github.com/thetatoken/theta/p2p/messenger.(*SeedPeerConnector).Start
/go/theta-protocol-ledger/p2p/messenger/disc_seed_peer_connector.go:77 +0x8d

goroutine 165 [IO wait]:
internal/poll.runtime_pollWait(0x7f41400cdf50, 0x72, 0x0)
/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc032b25018, 0x72, 0x0, 0x0, 0x12164d1)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc032b25000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_unix.go:401 +0x212
net.(*netFD).accept(0xc032b25000, 0xc05c9ede10, 0xc05c9ede08, 0x0)
/usr/local/go/src/net/fd_unix.go:172 +0x45
net.(*TCPListener).accept(0xc11bbe64e0, 0x1000000010000, 0xc02bf3aa80, 0xc05c9ede08)
/usr/local/go/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc11bbe64e0, 0xc0002eb001, 0x4, 0xc05c9ede80, 0x1)
/usr/local/go/src/net/tcpsock.go:261 +0x65
golang.org/x/net/netutil.(*limitListener).Accept(0xc11bbff770, 0x4, 0x1251d43, 0x42, 0xc05c9edf58)
/go/pkg/mod/golang.org/x/[email protected]/netutil/listen.go:48 +0x4e
github.com/thetatoken/theta/p2p/messenger.(*InboundPeerListener).listenRoutine(0xc11b1f7938)
/go/theta-protocol-ledger/p2p/messenger/disc_inbound_peer_listener.go:136 +0x13f
created by github.com/thetatoken/theta/p2p/messenger.(*InboundPeerListener).Start
/go/theta-protocol-ledger/p2p/messenger/disc_inbound_peer_listener.go:97 +0x9a

goroutine 166 [chan receive]:
github.com/thetatoken/theta/p2p/messenger.(*PeerDiscoveryMessageHandler).maintainSufficientConnectivityRoutine(0xc11b1f78b8)
/go/theta-protocol-ledger/p2p/messenger/disc_peer_discovery_message_handler.go:249 +0x79
created by github.com/thetatoken/theta/p2p/messenger.(*PeerDiscoveryMessageHandler).Start
/go/theta-protocol-ledger/p2p/messenger/disc_peer_discovery_message_handler.go:86 +0x9a

goroutine 167 [chan receive]:
github.com/thetatoken/theta/report.(*Reporter).reportOnlineAndSync(0xc061054280)
/go/theta-protocol-ledger/report/reporter.go:104 +0x3b
created by github.com/thetatoken/theta/report.(*Reporter).Start
/go/theta-protocol-ledger/report/reporter.go:86 +0x45

goroutine 168 [chan receive]:
github.com/thetatoken/theta/rpc.(*ThetaRPCServer).mainLoop(0xc121e33d10)
/go/theta-protocol-ledger/rpc/server.go:112 +0xa5
created by github.com/thetatoken/theta/rpc.(*ThetaRPCServer).Start
/go/theta-protocol-ledger/rpc/server.go:101 +0xbb

goroutine 169 [select]:
github.com/thetatoken/theta/rpc.(*ThetaRPCService).txCallback(0xc00036a820)
/go/theta-protocol-ledger/rpc/tx.go:96 +0x316
created by github.com/thetatoken/theta/rpc.(*ThetaRPCServer).Start
/go/theta-protocol-ledger/rpc/server.go:104 +0xfe

goroutine 170 [chan receive]:
github.com/thetatoken/theta/cmd/theta/cmd.memoryCleanupRoutine()
/go/theta-protocol-ledger/cmd/theta/cmd/start.go:359 +0x327
created by github.com/thetatoken/theta/cmd/theta/cmd.runStart
/go/theta-protocol-ledger/cmd/theta/cmd/start.go:171 +0x8d2

goroutine 171 [semacquire]:
sync.runtime_Semacquire(0xc0b2e5fa18)
/usr/local/go/src/runtime/sema.go:56 +0x45
sync.(*WaitGroup).Wait(0xc0b2e5fa10)
/usr/local/go/src/sync/waitgroup.go:130 +0x65
github.com/thetatoken/theta/consensus.(*ConsensusEngine).Wait(...)
/go/theta-protocol-ledger/consensus/engine.go:250
github.com/thetatoken/theta/node.(*Node).Wait(0xc12fc7b040)
/go/theta-protocol-ledger/node/node.go:147 +0x33
github.com/thetatoken/theta/cmd/theta/cmd.runStart.func4(0xc12fc7b040, 0xc0177921e0)
/go/theta-protocol-ledger/cmd/theta/cmd/start.go:175 +0x2b
created by github.com/thetatoken/theta/cmd/theta/cmd.runStart
/go/theta-protocol-ledger/cmd/theta/cmd/start.go:174 +0x81c

goroutine 172 [IO wait]:
internal/poll.runtime_pollWait(0x7f41400cdd80, 0x72, 0x0)
/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc05ac26118, 0x72, 0x0, 0x0, 0x12164d1)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc05ac26100, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_unix.go:401 +0x212
net.(*netFD).accept(0xc05ac26100, 0xc05ca75a60, 0xc05ca75a58, 0x0)
/usr/local/go/src/net/fd_unix.go:172 +0x45
net.(*TCPListener).accept(0xc095e8fbd8, 0x1000000010000, 0xc0b259c3c0, 0xc05ca75a58)
/usr/local/go/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc095e8fbd8, 0xc12309d001, 0x113f940, 0xc000058800, 0x0)
/usr/local/go/src/net/tcpsock.go:261 +0x65
golang.org/x/net/netutil.(*limitListener).Accept(0xc12309cf90, 0x1171c40, 0xc12309d080, 0x109b460, 0x1b35570)
/go/pkg/mod/golang.org/x/[email protected]/netutil/listen.go:48 +0x4e
net/http.(*Server).Serve(0xc0002567e0, 0x1569368, 0xc12309cf90, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:2981 +0x285
github.com/thetatoken/theta/rpc.(*ThetaRPCServer).serve(0xc121e33d10)
/go/theta-protocol-ledger/rpc/server.go:131 +0x3e5
created by github.com/thetatoken/theta/rpc.(*ThetaRPCServer).mainLoop
/go/theta-protocol-ledger/rpc/server.go:110 +0x6f

goroutine 58 [select]:
github.com/thetatoken/theta/common/timer.(*RepeatTimer).fireRoutine(0xc1099ac200, 0xc0c9fb84b0)
/go/theta-protocol-ledger/common/timer/repeat_timer.go:42 +0xe7
created by github.com/thetatoken/theta/common/timer.NewRepeatTimer
/go/theta-protocol-ledger/common/timer/repeat_timer.go:36 +0x145

goroutine 182 [select]:
github.com/thetatoken/theta/p2p/connection.(*Connection).sendRoutine(0xc0c9f83a20)
/go/theta-protocol-ledger/p2p/connection/connection.go:308 +0x1dd
created by github.com/thetatoken/theta/p2p/connection.(*Connection).Start
/go/theta-protocol-ledger/p2p/connection/connection.go:187 +0xa7

goroutine 183 [IO wait]:
internal/poll.runtime_pollWait(0x7f41400ce120, 0x72, 0xffffffffffffffff)
/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc05c554298, 0x72, 0x1000, 0x1000, 0xffffffffffffffff)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc05c554280, 0xc02d8d2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_unix.go:166 +0x1d5
net.(*netFD).Read(0xc05c554280, 0xc02d8d2000, 0x1000, 0x1000, 0x0, 0x0, 0xc12fc70358)
/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc15929a150, 0xc02d8d2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:183 +0x91
bufio.(*Reader).Read(0xc033690960, 0xc0e332c560, 0x20, 0x20, 0x42b83f, 0xc000020000, 0x10cb7c0)
/usr/local/go/src/bufio/bufio.go:227 +0x222
io.ReadAtLeast(0x7f412916e7c8, 0xc1414e81a0, 0xc0e332c560, 0x20, 0x20, 0x20, 0x4b761f, 0xc05caffe50, 0xaa5)
/usr/local/go/src/io/io.go:328 +0x87
io.ReadFull(...)
/usr/local/go/src/io/io.go:347
github.com/thetatoken/theta/p2p/connection.(*rlpxFrameRW).ReadPacket(0xc044234070, 0xca9875, 0x27a5ed0ae00, 0x2a)
/go/theta-protocol-ledger/p2p/connection/auth.go:549 +0xc7
github.com/thetatoken/theta/p2p/connection.(*Connection).readPacket(0xc0c9f83a20, 0x0, 0x0, 0x0)
/go/theta-protocol-ledger/p2p/connection/connection.go:390 +0x98
github.com/thetatoken/theta/p2p/connection.(*Connection).recvRoutine(0xc0c9f83a20)
/go/theta-protocol-ledger/p2p/connection/connection.go:421 +0xdc
created by github.com/thetatoken/theta/p2p/connection.(*Connection).Start
/go/theta-protocol-ledger/p2p/connection/connection.go:188 +0xc9

goroutine 187 [IO wait]:
internal/poll.runtime_pollWait(0x7f41400cdbb0, 0x72, 0xffffffffffffffff)
/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc0ad84ee98, 0x72, 0x1000, 0x1000, 0xffffffffffffffff)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc0ad84ee80, 0xc05cc05000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_unix.go:166 +0x1d5
net.(*netFD).Read(0xc0ad84ee80, 0xc05cc05000, 0x1000, 0x1000, 0x0, 0x0, 0xc12fc70358)
/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc127f882a0, 0xc05cc05000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:183 +0x91
bufio.(*Reader).Read(0xc01f1615c0, 0xc0c89668c0, 0x20, 0x20, 0x42b83f, 0xc000020000, 0x10cb7c0)
/usr/local/go/src/bufio/bufio.go:227 +0x222
io.ReadAtLeast(0x7f412916e7c8, 0xc01decc8c0, 0xc0c89668c0, 0x20, 0x20, 0x20, 0x4b761f, 0xc05cafae50, 0xaa2)
/usr/local/go/src/io/io.go:328 +0x87
io.ReadFull(...)
/usr/local/go/src/io/io.go:347
github.com/thetatoken/theta/p2p/connection.(*rlpxFrameRW).ReadPacket(0xc0442343f0, 0xca9875, 0x279c76b5b00, 0x2a)
/go/theta-protocol-ledger/p2p/connection/auth.go:549 +0xc7
github.com/thetatoken/theta/p2p/connection.(*Connection).readPacket(0xc0b4dca420, 0x0, 0x0, 0x0)
/go/theta-protocol-ledger/p2p/connection/connection.go:390 +0x98
github.com/thetatoken/theta/p2p/connection.(*Connection).recvRoutine(0xc0b4dca420)
/go/theta-protocol-ledger/p2p/connection/connection.go:421 +0xdc
created by github.com/thetatoken/theta/p2p/connection.(*Connection).Start
/go/theta-protocol-ledger/p2p/connection/connection.go:188 +0xc9

goroutine 63 [IO wait]:
internal/poll.runtime_pollWait(0x7f41400cde68, 0x72, 0xffffffffffffffff)
/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc036ec0398, 0x72, 0x1000, 0x1000, 0xffffffffffffffff)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc036ec0380, 0xc13d852000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_unix.go:166 +0x1d5
net.(*netFD).Read(0xc036ec0380, 0xc13d852000, 0x1000, 0x1000, 0x0, 0x0, 0xc12fc70358)
/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc01a6b0118, 0xc13d852000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:183 +0x91
bufio.(*Reader).Read(0xc0e1804540, 0xc0e7824ec0, 0x20, 0x20, 0x42b83f, 0xc000020000, 0x10cb7c0)
/usr/local/go/src/bufio/bufio.go:227 +0x222
io.ReadAtLeast(0x7f412916e7c8, 0xc13d81c060, 0xc0e7824ec0, 0x20, 0x20, 0x20, 0x4b761f, 0xc000266e50, 0xaa5)
/usr/local/go/src/io/io.go:328 +0x87
io.ReadFull(...)
/usr/local/go/src/io/io.go:347
github.com/thetatoken/theta/p2p/connection.(*rlpxFrameRW).ReadPacket(0xc131a94070, 0xca9875, 0x27a5ed0ae00, 0x2a)
/go/theta-protocol-ledger/p2p/connection/auth.go:549 +0xc7
github.com/thetatoken/theta/p2p/connection.(*Connection).readPacket(0xc0b24d4000, 0x0, 0x0, 0x0)
/go/theta-protocol-ledger/p2p/connection/connection.go:390 +0x98
github.com/thetatoken/theta/p2p/connection.(*Connection).recvRoutine(0xc0b24d4000)
/go/theta-protocol-ledger/p2p/connection/connection.go:421 +0xdc
created by github.com/thetatoken/theta/p2p/connection.(*Connection).Start
/go/theta-protocol-ledger/p2p/connection/connection.go:188 +0xc9

goroutine 65 [select]:
github.com/thetatoken/theta/p2p/connection.(*Connection).sendRoutine(0xc0b4dca2c0)
/go/theta-protocol-ledger/p2p/connection/connection.go:308 +0x1dd
created by github.com/thetatoken/theta/p2p/connection.(*Connection).Start
/go/theta-protocol-ledger/p2p/connection/connection.go:187 +0xa7

goroutine 195 [select]:
github.com/thetatoken/theta/common/timer.(*RepeatTimer).fireRoutine(0xc0002a58c0, 0xc047d856d0)
/go/theta-protocol-ledger/common/timer/repeat_timer.go:42 +0xe7
created by github.com/thetatoken/theta/common/timer.NewRepeatTimer
/go/theta-protocol-ledger/common/timer/repeat_timer.go:36 +0x145

rax 0x17
rbx 0xc010500000
rcx 0xffffffffffffffff
rdx 0x17
rdi 0x2
rsi 0x1227dc4
rbp 0x7f413f603cf0
rsp 0x7f413f6017e8
r8 0x2640da465d57e586
r9 0x84ca50c79dc69688
r10 0x42d73c7229f631bf
r11 0x206
r12 0x7f413f604ef0
r13 0x7f413f6032d0
r14 0x7f413f6046e0
r15 0x7f413f604f50
rip 0x4933a2
rflags 0x206
cs 0x33
fs 0x0
gs 0x0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant