Paddle
Paddle copied to clipboard
PaddlePaddle
Remove TRT static shape and bump into TRT 10.0
PR Category
Inference
PR Types
Bug fixes
Description
- Added support for TRT 10.0 since some deprecated APIs were removed.
- paddle/fluid/inference/tensorrt/engine.cc
- paddle/fluid/framework/new_executor/instruction/tensorrt_engine_instruction.cc
- Removed static shape support for Paddle-TRT.
- paddle/fluid/inference/tensorrt/convert/*_op.cc
- paddle/fluid/inference/tensorrt/engine.cc
- paddle/fluid/inference/tensorrt/engine.h
- paddle/fluid/inference/tensorrt/helper.h
- paddle/fluid/inference/tensorrt/op_teller.cc
- paddle/fluid/operators/tensorrt/tensorrt_engine_op.h
- Removed the static shape if-else condition in op converters.
- paddle/fluid/inference/tensorrt/convert/op_converter.h
- Modified static shape UTs to be dynamic shape UTs.
- Support calibration with dynamic shape (to fix UT
trt_split_converter_test) - Not all static shape UTs are removed. Currently Paddle-TRT can work for static shape when the batch size is equal to the max batch size.
你的PR提交成功，感谢你对开源项目的贡献! 请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。 Your PR has been submitted. Thanks for your contribution! Please wait for the result of CI firstly. See Paddle CI Manual for details.
![paddle-bot[bot] avatar](https://avatars.githubusercontent.com/in/216376?v=4 "Published by a pub.dev verified publisher"){kind=small}
Sorry to inform you that 82a77b8's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually.
![paddle-ci-bot[bot] avatar](https://avatars.githubusercontent.com/u/66985341?v=4 "Published by a pub.dev verified publisher"){kind=small}
- PR-CI-Approval:
2024-08-23 06:41:21 0. You must have raindrops2sea or XiaoguangHu01 approval for change 20+ files or add than 1000+ lines of content.
2024-08-23 06:41:21 1. Unittest is not allowed to be disabled.
2024-08-23 06:41:21 You must have one RD (kolinwei(Recommend), wanghuancoder, luotao1, QingshuChen, qili93 or ZzSean or Aurelius84) approval for the usage of @unittest.skip or @unittest.skipIf.
2024-08-23 06:41:21 [email protected](
2024-08-23 06:41:21 2. You must have one RD (From00, zhangbo9674) approval for file changes in paddle/fluid/framework/new_executor.
2024-08-23 06:41:21 There are 3 approved errors.
- PR-CI-Coverage: This should be exempted since the Paddle-TRT UT cannot cover op converters originally.
Sorry to inform you that 2e4a8bc's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually.