libonnx icon indicating copy to clipboard operation
libonnx copied to clipboard

Inference on GPU

Open drvshavva opened this issue 4 years ago • 4 comments

Hi, Can I build and use libonnx on gpu ?

drvshavva avatar Nov 10 '21 12:11 drvshavva

Need write a struct onnx_resolver_t, and the pass to onnx_context_alloc_from_file function

jianjunjiang avatar Nov 11 '21 05:11 jianjunjiang

thanks for answer :)

drvshavva avatar Nov 11 '21 11:11 drvshavva

hi again, you are saying that we need to write a struct onnx_resolver_t to infer on the gpu. Is it enough ? Is there any other need? And finally how do I change this struct onnx_resolver_t, what structure, what should I do? Many thanks in advance for all the replies :)

drvshavva avatar Nov 17 '21 06:11 drvshavva

Writing a solver requires a lot of work, you can refer to the default version of the solver implementation

jianjunjiang avatar Nov 18 '21 02:11 jianjunjiang