TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

py interface to implement export_profile export_layer_info and export_times?

Open xiangyun-hz opened this issue 3 years ago • 3 comments

Description

Is there a corresponding py interface to implement the three functions of export_times, export_profile and export_layer_info of trtexec? If not, is there a plan?

xiangyun-hz avatar Aug 16 '22 08:08 xiangyun-hz

It should be supported, but I'm not an expert on python API, @pranavm-nvidia might know more about it.

zerollzeng avatar Aug 16 '22 12:08 zerollzeng

something I know that might be helpful to you: https://docs.nvidia.com/deeplearning/tensorrt/api/python_api/infer/Core/EngineInspector.html https://docs.nvidia.com/deeplearning/tensorrt/api/python_api/infer/Core/Engine.html#tensorrt.ICudaEngine.create_engine_inspector https://docs.nvidia.com/deeplearning/tensorrt/api/python_api/infer/Core/BuilderConfig.html#tensorrt.ProfilingVerbosity https://docs.nvidia.com/deeplearning/tensorrt/api/python_api/infer/Core/ExecutionContext.html#tensorrt.IExecutionContext.report_to_profiler

zerollzeng avatar Aug 16 '22 12:08 zerollzeng

something I know that might be helpful to you: https://docs.nvidia.com/deeplearning/tensorrt/api/python_api/infer/Core/EngineInspector.html https://docs.nvidia.com/deeplearning/tensorrt/api/python_api/infer/Core/Engine.html#tensorrt.ICudaEngine.create_engine_inspector https://docs.nvidia.com/deeplearning/tensorrt/api/python_api/infer/Core/BuilderConfig.html#tensorrt.ProfilingVerbosity https://docs.nvidia.com/deeplearning/tensorrt/api/python_api/infer/Core/ExecutionContext.html#tensorrt.IExecutionContext.report_to_profiler

thanks a lot!

xiangyun-hz avatar Aug 17 '22 01:08 xiangyun-hz

have you solved the problem?

CharlesNord avatar Dec 06 '22 17:12 CharlesNord

closing since no activity for a long time, thanks all!

ttyio avatar Jul 13 '23 03:07 ttyio