Adrian Tobiszewski
Adrian Tobiszewski
@desantosa Could you share OVMS logs with log_level DEBUG? Did you try using OVMS client as an alternative?
Hi @kthui could you share more details about your Windows machine? We did not encounter issues when building pure OV on Win11: ``` cmake -G "Visual Studio 17 2022" -DCMAKE_BUILD_TYPE=Release...
Hi @jiekechoo I think the easiest way is just to load model in OVMS and check logs. on --log_level INFO (default) you should see lines like these: ``` [2024-03-18 21:53:05.366][1][modelmanager][info][modelinstance.cpp:490]...
Did you check examples: https://docs.openvino.ai/2024/ovms_docs_dag.html#pipelines-examples-a-name-pipeline-examples-a ? I don't know what specific part of custom pipeline creation is ambiguous for you so I would recommend looking at: https://github.com/openvinotoolkit/model_server/blob/main/docs/demultiplexing.md#basic-demultiplexer-example-and-metadata-explanation as it shows...
Hi, you are getting error that OVMS expects more inputs than you provide. I assume that you use some kind of wrapper for OV model that encapsulates the fact that...
I found out that in the Triton image there are 2 versions of OpenVINO, and one of them is missing libraries from OpenVINO: ``` root@8bc8eab2d6ce:/# find -name "*openvino*" | grep...
@tanmayv25 This paragraph states otherwise: https://github.com/triton-inference-server/openvino_backend#loading-non-default-model-format. When I removed ONNX backend from Triton image & tuned shape parameters in config it worked fine.
Hi @goetzrieger there is merge request with work in progress: https://github.com/openvinotoolkit/model_server/pull/2485 Not all features of OVMS work there yet(no Mediapipe graphs, no azure cloud) and there is not ETA for...
Hi @jiekechoo Could you provide reproduction steps on client side? What is the CPU usage at the time of observing this error? What are OVMS logs at time of this...
Encountered the same issue with `gguf_open` when downloading models as one user, and then using it with container as different one. It would make sense to at least be able...