wfd2022

Results 1 issues of wfd2022

The time spent on the inference request process far exceeds the model inference time. How can I determine where this additional time is being consumed?

When I use curl localhost:10502/metrics to get the model's runtime status, I find that the total latency time is much longer than the inference time, as indicated by the red...