How to do model.prediction in batches?

Open janipaDev opened this issue 3 years ago • 0 comments

Hi, I tried using keras.net , I was able to do model.predict for images by running through a loop and predict them one by one. However I discovered that it seems to be quite slow and does not utilizes the GPU efficiently.

So I wonder if anyone knows how to do model.predict for batches of images so to do inference more efficiently?

Apr 05 '22 05:04 janipaDev