TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

Global tensors with dynamic slice using python

Open zengrh3 opened this issue 1 year ago • 1 comments

Let say I define a global tensor t1, where shape is [1, 12, 2000, 112], and the actual input tensor t2 shape is [1, 12, 40, 112]. I have copied the actual value of t2 to t1 using _copy, and in the inner model logic, I use slice to get the actual content, like t1[:, :, :40, :].

However, I found this does not work in TensorRT, but works in ONNX. So how can I deal with this ?

zengrh3 avatar Oct 30 '24 07:10 zengrh3

Are you able to create an ONNX model with this? You can try parsing an ONNX model with TensorRT https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#onnx-intro

yuanyao-nv avatar Oct 31 '24 17:10 yuanyao-nv