chatglm3 6b error

[zhm-algo]

bash ./run_benchmark.sh -m chatglm3-6b -d nf4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d int4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_nf4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d w8a8_nf4 -s 1 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d w8a8_int4 -s 1 -bs 1 -in 256 -out 256 -i 1

bash ./run_benchmark.sh -m chatglm3-6b -d bf16 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d int8 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d nf4 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_fp16 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_w8a8 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int8 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_int4 -s 2 -bs 1 -in 256 -out 256 -i 1 bash ./run_benchmark.sh -m chatglm3-6b -d bf16_nf4 -s 2 -bs 1 -in 256 -out 256 -i 1

执行上述命令会报错，报错信息如下：

= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 0 PID 2425 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)

=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 1 PID 2426 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)

=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 2 PID 2427 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)

=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 3 PID 2428 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)

=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 4 PID 2429 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)

=================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = RANK 7 PID 2432 RUNNING AT b9e7b8d7f3d3 = KILLED BY SIGNAL: 9 (Killed)

[pujiang2018]

@abenmao let's take time for possible fix.