yohnyang
yohnyang
[12/25/2023-12:32:49] [I] [TRT] [MemUsageChange] Init CUDA: CPU +442, GPU +0, now: CPU 14318, GPU 1252 (MiB) [12/25/2023-12:32:49] [I] [TRT] Loaded engine size: 7 MiB [12/25/2023-12:32:49] [I] [TRT] [MemUsageChange] TensorRT-managed allocation...
台式机
batch推理的，不过设置的batchsize=1，每次推理一张图