torch2trt_dynamic

torch2trt_dynamic copied to clipboard

install error

2

(zk_mmdet2.4) yyf@zyzn:~/software/torch2trt$ sudo python setup.py install [sudo] password for yyf: Traceback (most recent call last): File "setup.py", line 8, in from build import build File "/home/yyf/software/torch2trt/build.py", line 29, in torch_dir=imp.find_module('torch')[1],...

zkloveai

Hi, how to solve it with list output?

2

I got this error when using list as output: ``` line 408, in mark_outputs trt_tensor = torch_output._trt AttributeError: 'list' object has no attribute '_trt' ```

lucasjinreal

WARNING: Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: (+ (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (+ (# 3 (SHAPE input_0)) -1) 2) 2) 2) 2) 2) 1) (+ (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (FLOOR_DIV (+ (# 2 (SHAPE input_0)) -1) 2) 2) 2) 2) 2) 1)

4

Hi, the error I got: [TensorRT] INFO: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [TensorRT] WARNING: Myelin...

LeoRainly

When I executed the following usage code given in the README file, I found that the code is consuming 25% of RAM. ```from torch2trt_dynamic import torch2trt_dynamic import torch from torch...

sathisha-beltech

Error number of channels in input tensor to a convolution layer must not be dynamic

2

Hi. I'm trying using torch2trt_dynamic to convert models from torch to trt. I got an unexpected issue. To reproduce it I use lenet5 like neural network. ``` from torch2trt_dynamic import...

Kracozebr

Consider adding support for DLA (Deep learning accelerator) modules

3

Some platforms including Jetson Xavier AGX and NX supports DLA modules. However, when converting the pytorch module to tensorrt, it will never attempt to use DLA cores but will always...

tehkillerbee

how to add a converter for custom operateion written by c++

1

the model i used has some opration written by c++, using torch.utils.cpp_extention with a .cpp file. I want to convert the model into trt model but failed with the error...

deemoo-wang

Why official torch2trt doesn't invoke any plugin, but this invoke too many plugins even with simple model

4

I tested mobilenetv2. In official repo, it can generate without any plugin, this repo will have.   I doesn't need dynamic in simple model, what's the differences between offical...

lucasjinreal

Error Code 9: Internal Error ((Unnamed Layer* 3886) [ElementWise]: broadcast dimensions must be conformable )

3

Hi, I'm trying to build engine from pytorch model (resnest200 backboned) with float16 conversion. Unfortunately I got an error: `[TensorRT] ERROR: 9: [graphShapeAnalyzer.cpp::throwIfError::1306] Error Code 9: Internal Error ((Unnamed Layer*...

Tailwhip

RuntimeError: NVRTC error when convert model

5

This error occurs when I convert any model, the error log is `cooperative_groups_helpers.h(87): error: identifier "cudaCGSynchronizeGrid" is undefined` `1 error detected in the compilation of "generatedNativePointwise".` `Traceback (most recent call...

HHZ94