tiny-tensorrt

tiny-tensorrt copied to clipboard

Increasing batch size does not improve efficiency

3

When I increase batch size, the inference time on TensorRT does not change. Basically if inference time on the batch with size 8 took 20ms. Inference on batch size 16...

mrpositron

Add `target_include_directories` to `CMakeLists.txt` so that `Trt.h` can be automatically added to include path when `tinytrt` be in `target_link_libraries` 在 `CMakeLists.txt` 中使用 `target_include_directories` 来 include 根目录，这样使用 `target_link_libraries` 链接到 `tinytrt` 时会自动将（含有...

shirok1

我写了一个使用tinytrt来实现yolov5预测的示例，是否能在samples中提交pr？ I wrote an example of using tinytrt to implement yolov5 prediction, can I submit pr in samples

2

提供tinytrt-yolov5作为一个示例，很多人可以进行参考。trt很大一部分用户都是用于目标检测的。 Provide yolov5 as an example, many people can refer to. A large portion of trt users are used for object detection.

zjhellofss

按照样例倒入生成的.so文件后，显示没有 pytrt这个包

2

please descript your problem in **English** if possible. it will to helpful to more people **Describe the bug** A clear and concise description of what the bug is. **To Reproduce**...

OutBreak-hui

CuteSamplePlugin

2

Hi大佬，可以提供一下readme中描述的测试代码和模型吗，感谢！ 这是我的邮箱 [email protected]

sinterwong

'pytrt.Trt' object has no attribute 'AddDynamicShapeProfile'

1

can I get help on how to run with dynamic shape input in python? can you add an example in python? ```py import cv2 import tritonclient.grpc as grpc_client import time...

mahesh11T

Always got nan result.

2

the model is resnet50 from TensorRT8 folder. onnx can produce the correct result, but tinytrt can't.  the onnx result  the tinytrt result 

EEWenbinWu

Why does Int8 quantization occupy more GPU graphics memory than float16, TensorRT quantization ?

8

please descript your problem in **English** if possible. it will to helpful to more people **Describe the bug** A clear and concise description of what the bug is. **To Reproduce**...

nameli0722

Support for TRT8.5 and 8.6?

1

Thanks for your nice work! Is there any plan for supporting trt8.5 and recently released trt8.6?

QiangZhangCV