[Bug]: [date 1.11] tke regression: establish a connection takes 3 minutes
Is there an existing issue for the same bug?
- [X] I have checked the existing issues.
Branch Name
main
Commit ID
dd90efb5a
Other Environment Information
- Hardware parameters:
- OS type:
- Others:
Actual Behavior
job:https://github.com/matrixorigin/mo-nightly-regression/actions/runs/7490212917/job/20400077309
mo log: http://175.178.192.213:30088/explore?panes=%7B%22qYx%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-nightly-regression-20240111%5C%22%7D%20%7C%3D%20%60%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221705005180000%22,%22to%22:%221705005720000%22%7D%7D%7D&schemaVersion=1&orgId=1
Expected Behavior
No response
Steps to Reproduce
tke regression
Additional information
No response
@LeftHandCold 辛苦将定位信息贴一下
发现当时的cn只打印一些定时任务的log,和频繁打印goroutine,查看goroutine的metrics,发现当时数量比较多,不知道是否正常。
http://175.178.192.213:30088/d/e3623bad-403a-41f2-956e-21196de1f2ec/go-runtime-metrics?orgId=1&from=now-12h&to=now&var-interval=1m&var-namespace=mo-nightly-regression-20240111&var-pod=All
@zhangxu19830126 please take a look at this issue
maybe fixed by #14176. Too many socket connections maybe cause this problem
But the log means, txn leak happened, please take a look @daviszhen
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入
未投入