UKD
Gentle reminder for addressing the same. Thanks and Regards,
would you please comment ?
same here, for https://github.com/nebuly-ai/nebullvm/blob/main/resources/notebooks/Accelerate-PyTorch-YOLO-with-nebullvm.ipynb as well, I am not getting any improvements, rather the same/or more latency.
@morgoth95 Machine/ OS details: Virtualization: microsoft Operating System: Ubuntu 18.04.6 LTS Kernel: Linux 5.4.0-1078-azure Architecture: x86-64 vCPUs = 16 RAM=128 GB More context: I am trying to optimize inference time...
@morgoth95 tried reinstalling from source and ran the yolov5 tutorial again, but still there is no improvement in latency. please have a look at my version of the notebook here...