onnxruntime icon indicating copy to clipboard operation
onnxruntime copied to clipboard

ONNX Runtime doesn't support the graph optimization of vision-encoder-decoder yet

Open CrasCris opened this issue 1 year ago • 0 comments

Is there another way to quantized TrOCR model to speed the inference, i alreayd have in ONNX form but the inference time is to high

CrasCris avatar May 16 '24 16:05 CrasCris