Taoz27 issues

Repositories
Issues
Comments

Results 1 issues of


                                            Taoz27

[Question] [TREx] Unexpected TREx Layer-Sum vs End-to-End Latency Behavior in LLM Generation Phase (Qwen2-VL on NVIDIA Thor)

## Description I am analyzing the performance of the Qwen2-VL model on NVIDIA Thor using the TREx (TensorRT Engine Explorer) tool. According to the README, when using trtexec to time...

Module:Quantization

Module:TREx