TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard
verified publisher icon NVIDIA

CPU Inference

Open JocelynPanPan opened this issue 1 year ago • 0 comments

Could TensorRT-LLM use only CPU for inference?

JocelynPanPan avatar Oct 09 '24 17:10 JocelynPanPan