bevdet-tensorrt-cpp icon indicating copy to clipboard operation
bevdet-tensorrt-cpp copied to clipboard
verified publisher icon LCH1238

The program execution time is a bit long

Open 15116513319 opened this issue 2 years ago • 3 comments

Thanks for your greate job! I execute this program on Jetson Orin 16G，But the program execution time is a bit long： ...... -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 [Preprocess ] cost time: 19.340 ms [Image stage ] cost time: 126.830 ms [BEV pool ] cost time: 3.655 ms [Align Feature] cost time: 10.830 ms [BEV stage ] cost time: 33.886 ms [Postprocess ] cost time: 3.629 ms [Infer total ] cost time: 198.171 ms Detect 100 objects -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 [Preprocess ] cost time: 13.267 ms [Image stage ] cost time: 91.173 ms [BEV pool ] cost time: 4.079 ms [Align Feature] cost time: 7.566 ms [BEV stage ] cost time: 33.450 ms [Postprocess ] cost time: 4.519 ms [Infer total ] cost time: 154.055 ms Detect 100 objects

Does anyone know why?

15116513319 avatar Jul 17 '23 09:07 15116513319

Thanks for your greate job! I execute this program on Jetson Orin 16G，But the program execution time is a bit long： ...... -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 [Preprocess ] cost time: 19.340 ms [Image stage ] cost time: 126.830 ms [BEV pool ] cost time: 3.655 ms [Align Feature] cost time: 10.830 ms [BEV stage ] cost time: 33.886 ms [Postprocess ] cost time: 3.629 ms [Infer total ] cost time: 198.171 ms Detect 100 objects -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 [Preprocess ] cost time: 13.267 ms [Image stage ] cost time: 91.173 ms [BEV pool ] cost time: 4.079 ms [Align Feature] cost time: 7.566 ms [BEV stage ] cost time: 33.450 ms [Postprocess ] cost time: 4.519 ms [Infer total ] cost time: 154.055 ms Detect 100 objects

Does anyone know why?

What is your power mode setting? My device is Jetson AGX Orin Developer Kits and the power mode is MAXN. Also, you can make the program infer more samples , it will be slow at first.

LCH1238 avatar Jul 17 '23 10:07 LCH1238

我改成了最大功率运行，帧率帧率还是没有达到您公布的效果： scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:5.969ms,Image stage:42.057ms,BEV pool:1.513ms,Align Feature:3.654ms,BEV stage:14.944ms, Postprocess:1.309ms, total:69.447ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:5.873ms,Image stage:42.296ms,BEV pool:1.530ms,Align Feature:3.946ms,BEV stage:15.059ms, Postprocess:1.456ms, total:70.161ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:6.280ms,Image stage:41.885ms,BEV pool:1.688ms,Align Feature:4.522ms,BEV stage:15.408ms, Postprocess:1.312ms, total:71.095ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:5.933ms,Image stage:42.711ms,BEV pool:1.515ms,Align Feature:4.197ms,BEV stage:15.002ms, Postprocess:1.304ms, total:70.662ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:5.914ms,Image stage:42.120ms,BEV pool:1.642ms,Align Feature:4.373ms,BEV stage:15.162ms, Postprocess:1.466ms, total:70.679ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:6.276ms,Image stage:42.217ms,BEV pool:1.947ms,Align Feature:3.647ms,BEV stage:15.545ms, Postprocess:1.495ms, total:71.127ms

15116513319 avatar Jul 19 '23 07:07 15116513319

我改成了最大功率运行，帧率帧率还是没有达到您公布的效果： scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:5.969ms,Image stage:42.057ms,BEV pool:1.513ms,Align Feature:3.654ms,BEV stage:14.944ms, Postprocess:1.309ms, total:69.447ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:5.873ms,Image stage:42.296ms,BEV pool:1.530ms,Align Feature:3.946ms,BEV stage:15.059ms, Postprocess:1.456ms, total:70.161ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:6.280ms,Image stage:41.885ms,BEV pool:1.688ms,Align Feature:4.522ms,BEV stage:15.408ms, Postprocess:1.312ms, total:71.095ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:5.933ms,Image stage:42.711ms,BEV pool:1.515ms,Align Feature:4.197ms,BEV stage:15.002ms, Postprocess:1.304ms, total:70.662ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:5.914ms,Image stage:42.120ms,BEV pool:1.642ms,Align Feature:4.373ms,BEV stage:15.162ms, Postprocess:1.466ms, total:70.679ms -------------------0------------------- scenes_token : e7ef871f77f44331aefdebc24ec034b7, timestamp : 1533201470448696 Preprocess:6.276ms,Image stage:42.217ms,BEV pool:1.947ms,Align Feature:3.647ms,BEV stage:15.545ms, Postprocess:1.495ms, total:71.127ms

image 不同版本之间的orin，性能有所差异

LCH1238 avatar Jul 19 '23 09:07 LCH1238