ortex
ortex copied to clipboard
elixir-nx
ONNX Runtime bindings for Elixir
Hi I had an issue getting the Ortex compiled in a Docker container, and then an issue running the tests on a Mac, which I thought might have been caused...
Hey, I am trying to use [silero_vad](https://github.com/snakers4/silero-vad) and for that it seem to me, I need an up to date version of ort and therefore the current versin of "ortex"...
Hey there! Any plans to add CI workflows w/ Rustler Precompiled? Would definitely help with deployment.
Having `Nx.argmax` implemented will help to reduce `backend_transfer` calls when recursively calling Ortex for applications that use greedy search, beam search, etc.
Hello! :heart: the library, I'm using it right now to run inference on a BERT fine-tuned for sequence classification. @mortont do you think it would be helpful to add an...
In working on a [segment-anthing livebook](https://github.com/elixir-image/image/blob/main/livebook/sement_anything.livemd), based upon [this forum example](https://elixirforum.com/t/almost-able-to-run-facebooks-segmentation-model-using-ortex/63422), I am downloading the onnx model from hugging face. The benefit is that the Livebook can be readily shared...
I'd like to use this with the pretrained pyannote, but it uses ONNX ML opset version 4, which isn't supported by 1.14. I attempted the upgrade naively and got: ```...
After the upgrade to `ort-2.0.0-rc.0` (d00092f), building on an Intel Mac results in: ``` == Compilation error in file lib/ortex/native.ex == ** (File.CopyError) could not copy from "/Users/mwhitworth/personal/ortex/_build/dev/lib/ortex/priv/native/libonnxruntime.so" to "/Users/mwhitworth/personal/ortex/_build/dev/lib/ortex/priv/native/libonnxruntime.so.1.17.0":...
I'm trying to run the pre-built Phi-3 ONNX Optimized models that are found on HuggingFace here: https://huggingface.co/microsoft/Phi-3-mini-128k-instruct-onnx. They have pre-built ONNX models that are runnable on CPUs in their repo,...
Relevant output log: Error seems to be: ``` aarch64-nerves-linux-gnu-gcc: error: unrecognized command-line option '-m64' thread 'main' panicked at /home/lawik/.cargo/registry/src/index.crates.io-6f17d22bba15001f/ring-0.16.20/build.rs:656:9: ``` This? https://github.com/briansmith/ring/issues/2009 ``` ... Compiling zip v0.6.4 Compiling tar v0.4.38...
