linchpinlin

onnx model info: `model.graph.input: [name: "input_ids" type { tensor_type { elem_type: 6 shape { dim { dim_param: "batch_size" } dim { dim_value: 500 } } } } ]` `model.graph.output: [name:...

Qwen2-72B-Instruct-GPTQ-Int4 Conversion Success, Run Failure

5

### System Info NVIDIA-SMI 535.154.05 Driver Version: 535.154.05 CUDA Version: 12.4 - GPU properties - GPU name: NVIDIA L20 - GPU memory size: 46068MiB - Libraries - TensorRT-LLM branch: main...