matrixone icon indicating copy to clipboard operation
matrixone copied to clipboard

[Bug]: 1.2-dev standalone: sysbench bulk_insert 100threads test mo oom

Open heni02 opened this issue 1 year ago • 3 comments

Is there an existing issue for the same bug?

  • [X] I have checked the existing issues.

Branch Name

1.2-dev

Commit ID

6cfdcaf20fb7cda1a027e1b5c0b837607d4442d7

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

job:https://github.com/matrixorigin/mo-nightly-regression/actions/runs/9536425137/job/26283375736 企业微信截图_a94238ba-5139-4d79-953a-79e4179e241e oom时间04:48:25 企业微信截图_1cdd13e0-3e15-45b2-9136-18041844e059

oom前heap: heap_019022b9-0526-7e0a-9b0c-648731f5cf5d.gz heap_019022b8-9007-7bef-889d-171780b05b15.gz heap_019022b9-ef97-7447-b429-f85a47b2af74 (1).gz heap_019022b9-7a5f-7937-bd29-6edbb5171dad.gz 企业微信截图_9c9d4ca5-2a9c-4d8d-b10e-05b6ad673630

mo log plz contact me

Expected Behavior

No response

Steps to Reproduce

sysbench  --mysql-host=127.0.0.1 --mysql-port=6001 --mysql-user=dump --mysql-password=111 bulk_insert.lua --mysql-db=sysbench_db --tables=10 --table_size=100000 --threads=100 --time=30 --report-interval=10 prepare
sysbench  --mysql-host=127.0.0.1 --mysql-port=6001 --mysql-user=dump --mysql-password=111  bulk_insert.lua --mysql-db=sysbench_db --tables=10 --table_size=100000 --threads=100 --time=300 --report-interval=10 --range_selects=off --point_selects=1 run

Additional information

No response

heni02 avatar Jun 17 '24 03:06 heni02

目前没有进展

w-zr avatar Jun 26 '24 15:06 w-zr

目前没有进展

w-zr avatar Jul 03 '24 11:07 w-zr

目前没有进展

w-zr avatar Jul 09 '24 11:07 w-zr

目前没有进展

w-zr avatar Jul 15 '24 12:07 w-zr

目前正在优化手动merge操作。

w-zr avatar Jul 18 '24 11:07 w-zr

一个优化merge 内存占用的pr合进main了 我最近测一下

w-zr avatar Jul 24 '24 10:07 w-zr

image 最新的main上bulk insert 100没有oom

w-zr avatar Jul 25 '24 07:07 w-zr

image 最新的main上拉通跑sysbench 10w, bulk insert 1000没有OOM

w-zr avatar Jul 25 '24 10:07 w-zr

后续会把https://github.com/matrixorigin/matrixone/pull/17656 合并到1.2-dev上

w-zr avatar Jul 25 '24 11:07 w-zr

等#17734 合并了就可以了

w-zr avatar Jul 31 '24 10:07 w-zr

confirm,closed

heni02 avatar Aug 07 '24 11:08 heni02