batch-inference-benchmarks icon indicating copy to clipboard operation
batch-inference-benchmarks copied to clipboard
verified publisher icon amogkam

Tensor RT with Ray

Open vincentvic opened this issue 2 years ago • 0 comments

Hi ! I'm curious if it's possible to convert a tensorflow model to tensor rt and use after that Ray for a batch inference ? Thank you

vincentvic avatar Sep 06 '23 14:09 vincentvic