OpenMLDB
OpenMLDB copied to clipboard
4paradigm
Is the memused value of a segment reasonable
Bug Description After loading the file
Welcome to openmldb with version 0.6.0-01a7a67
ns leader: 10.97.152.110:6527
Use database: kafka_test
name tid pid endpoint role is_alive offset record_cnt memused diskused
------------------------------------------------------------------------------------------------------------------------
shopping_log_info_table_3 29 0 10.97.152.110:9527 follower yes 8907800 8907800 4.727 G 4.065 G
shopping_log_info_table_3 29 0 10.97.152.190:9527 leader yes 8907800 8907800 4.727 G 4.069 G
shopping_log_info_table_3 29 0 10.97.152.199:9527 follower yes 8907800 8907800 4.727 G 4.075 G
shopping_log_info_table_3 29 1 10.97.152.110:9527 follower yes 0 0 0.000 3.944 K
shopping_log_info_table_3 29 1 10.97.152.190:9527 follower yes 0 0 0.000 3.944 K
shopping_log_info_table_3 29 1 10.97.152.199:9527 leader yes 0 0 0.000 4.003 K
shopping_log_info_table_3 29 2 10.97.152.110:9527 leader yes 0 0 0.000 4.003 K
shopping_log_info_table_3 29 2 10.97.152.190:9527 follower yes 0 0 0.000 3.944 K
shopping_log_info_table_3 29 2 10.97.152.199:9527 follower yes 0 0 0.000 3.937 K
shopping_log_info_table_3 29 3 10.97.152.110:9527 follower yes 67467 67467 29.435 M 21.410 M
shopping_log_info_table_3 29 3 10.97.152.190:9527 leader yes 67467 67467 29.435 M 21.420 M
shopping_log_info_table_3 29 3 10.97.152.199:9527 follower yes 67467 67467 29.435 M 21.441 M
shopping_log_info_table_3 29 4 10.97.152.110:9527 follower yes 6 6 2.673 K 6.380 K
shopping_log_info_table_3 29 4 10.97.152.190:9527 follower yes 6 6 2.673 K 6.388 K
shopping_log_info_table_3 29 4 10.97.152.199:9527 leader yes 6 6 2.673 K 6.446 K
shopping_log_info_table_3 29 5 10.97.152.110:9527 leader yes 3 3 1.381 K 5.189 K
shopping_log_info_table_3 29 5 10.97.152.190:9527 follower yes 3 3 1.381 K 5.123 K
shopping_log_info_table_3 29 5 10.97.152.199:9527 follower yes 3 3 1.381 K 5.135 K
shopping_log_info_table_3 29 6 10.97.152.110:9527 follower yes 18 18 7.681 K 11.234 K
shopping_log_info_table_3 29 6 10.97.152.190:9527 leader yes 18 18 7.681 K 11.289 K
shopping_log_info_table_3 29 6 10.97.152.199:9527 follower yes 18 18 7.681 K 11.234 K
shopping_log_info_table_3 29 7 10.97.152.110:9527 follower yes 0 0 0.000 3.944 K
shopping_log_info_table_3 29 7 10.97.152.190:9527 follower yes 0 0 0.000 3.944 K
shopping_log_info_table_3 29 7 10.97.152.199:9527 leader yes 0 0 0.000 4.011 K
last night
10.97.152.110:6527 kafka_test> showtable shopping_log_info_table_3
name tid pid endpoint role is_alive offset record_cnt memused diskused
--------------------------------------------------------------------------------------------------------------------------
shopping_log_info_table_3 29 0 10.97.152.110:9527 follower yes 8925049 8907800 5.281 G 5.139 G
shopping_log_info_table_3 29 0 10.97.152.190:9527 leader yes 8925049 8907800 5.281 G 5.139 G
shopping_log_info_table_3 29 0 10.97.152.199:9527 follower yes 8925049 8907800 5.281 G 5.139 G
shopping_log_info_table_3 29 1 10.97.152.110:9527 follower yes 3735406 0 752.281 M 2.286 G
shopping_log_info_table_3 29 1 10.97.152.190:9527 follower yes 3735406 0 752.283 M 2.286 G
shopping_log_info_table_3 29 1 10.97.152.199:9527 leader yes 3735406 0 752.273 M 2.286 G
shopping_log_info_table_3 29 2 10.97.152.110:9527 leader yes 661320 0 165.632 M 517.735 M
shopping_log_info_table_3 29 2 10.97.152.190:9527 follower yes 661320 0 165.635 M 517.694 M
shopping_log_info_table_3 29 2 10.97.152.199:9527 follower yes 661320 0 165.635 M 517.681 M
shopping_log_info_table_3 29 3 10.97.152.110:9527 follower yes 3084513 67467 1.319 G 2.024 G
shopping_log_info_table_3 29 3 10.97.152.190:9527 leader yes 3084513 67467 1.319 G 2.024 G
shopping_log_info_table_3 29 3 10.97.152.199:9527 follower yes 3084513 67467 1.319 G 2.024 G
shopping_log_info_table_3 29 4 10.97.152.110:9527 follower yes 2542290 6 711.332 M 1.576 G
shopping_log_info_table_3 29 4 10.97.152.190:9527 follower yes 2542290 6 711.335 M 1.576 G
shopping_log_info_table_3 29 4 10.97.152.199:9527 leader yes 2542290 6 711.332 M 1.576 G
shopping_log_info_table_3 29 5 10.97.152.110:9527 leader yes 1720955 3 443.953 M 1.147 G
shopping_log_info_table_3 29 5 10.97.152.190:9527 follower yes 1720955 3 443.957 M 1.147 G
shopping_log_info_table_3 29 5 10.97.152.199:9527 follower yes 1720955 3 443.957 M 1.147 G
shopping_log_info_table_3 29 6 10.97.152.110:9527 follower yes 1509327 18 406.946 M 1.189 G
shopping_log_info_table_3 29 6 10.97.152.190:9527 leader yes 1509327 18 406.946 M 1.189 G
shopping_log_info_table_3 29 6 10.97.152.199:9527 follower yes 1509327 18 406.946 M 1.189 G
shopping_log_info_table_3 29 7 10.97.152.110:9527 follower yes 1491416 0 402.287 M 1.167 G
shopping_log_info_table_3 29 7 10.97.152.190:9527 follower yes 1491416 0 402.291 M 1.167 G
shopping_log_info_table_3 29 7 10.97.152.199:9527 leader yes 1491416 0 402.287 M 1.167 G
today morning
10.97.152.110:6527 kafka_test> showtable shopping_log_info_table_3
name tid pid endpoint role is_alive offset record_cnt memused diskused
--------------------------------------------------------------------------------------------------------------------------
shopping_log_info_table_3 29 0 10.97.152.110:9527 follower yes 8925049 8907800 5.251 G 5.139 G
shopping_log_info_table_3 29 0 10.97.152.190:9527 leader yes 8925049 8907800 5.251 G 5.139 G
shopping_log_info_table_3 29 0 10.97.152.199:9527 follower yes 8925049 8907800 5.251 G 5.139 G
shopping_log_info_table_3 29 1 10.97.152.110:9527 follower yes 3735406 0 684.108 M 2.595 G
shopping_log_info_table_3 29 1 10.97.152.190:9527 follower yes 3735406 0 684.109 M 2.595 G
shopping_log_info_table_3 29 1 10.97.152.199:9527 leader yes 3735406 0 684.109 M 2.595 G
shopping_log_info_table_3 29 2 10.97.152.110:9527 leader yes 661320 0 156.355 M 517.735 M
shopping_log_info_table_3 29 2 10.97.152.190:9527 follower yes 661320 0 156.355 M 517.694 M
shopping_log_info_table_3 29 2 10.97.152.199:9527 follower yes 661320 0 156.355 M 517.681 M
shopping_log_info_table_3 29 3 10.97.152.110:9527 follower yes 3084513 67467 1.277 G 2.697 G
shopping_log_info_table_3 29 3 10.97.152.190:9527 leader yes 3084513 67467 1.277 G 2.697 G
shopping_log_info_table_3 29 3 10.97.152.199:9527 follower yes 3084513 67467 1.277 G 2.697 G
shopping_log_info_table_3 29 4 10.97.152.110:9527 follower yes 2542290 6 677.061 M 1.905 G
shopping_log_info_table_3 29 4 10.97.152.190:9527 follower yes 2542290 6 677.062 M 1.905 G
shopping_log_info_table_3 29 4 10.97.152.199:9527 leader yes 2542290 6 677.061 M 1.905 G
shopping_log_info_table_3 29 5 10.97.152.110:9527 leader yes 1720955 3 418.279 M 1.290 G
shopping_log_info_table_3 29 5 10.97.152.190:9527 follower yes 1720955 3 418.279 M 1.290 G
shopping_log_info_table_3 29 5 10.97.152.199:9527 follower yes 1720955 3 418.279 M 1.290 G
shopping_log_info_table_3 29 6 10.97.152.110:9527 follower yes 1509327 18 386.919 M 1.189 G
shopping_log_info_table_3 29 6 10.97.152.190:9527 leader yes 1509327 18 386.919 M 1.189 G
shopping_log_info_table_3 29 6 10.97.152.199:9527 follower yes 1509327 18 386.919 M 1.189 G
shopping_log_info_table_3 29 7 10.97.152.110:9527 follower yes 1491416 0 382.467 M 1.167 G
shopping_log_info_table_3 29 7 10.97.152.190:9527 follower yes 1491416 0 382.467 M 1.167 G
shopping_log_info_table_3 29 7 10.97.152.199:9527 leader yes 1491416 0 382.467 M 1.167 G
Expected Behavior
Steps to Reproduce
./wrk2 -t 10 -c 30 -d 30s -R 300 -s post.lua --latency http://10.97.152.111:10080/dbs/kafka_test/deployments/demo1
post.lua `wrk.method = "POST"
wrk.body = '{"input":[["1234","1f712bc4-2633-xxxx-9adf-ac1e6ed3d053","5fde91b79d7a1f6ef1310745xxxxxxxd193e82e51c70251d35cb","395cbafec2b10edfdcd29d9fdxxxxxxc741bb98ba4e82b89cbb68d7e2cb94e","5FDE91B79D7A1F6EF131074500D692xxxxx436D193E82E51C70251D35CB","xxx突查特朗普的海湖庄园原因","NULL","NULL","NULL","bdd9fdbf-xxxx-4ecf-xxxx-8b3bcb5473d1",1661227482175,1660627507251,"12.0.6.300","ec84a6984xxxxbfcaa36566cb8","xxx-AN00","6.1"]],"need_schema":false}'
wrk.headers["Content-Type"] = "application/json" wrk.headers["Connection"] = "close"
function request()
return wrk.format('POST', nil, nil, body)
end`