Sreerag

Unsupported qwen2_5_vl

11

I tried quantizing the Qwen/Qwen2.5-VL-3B-Instruct using the below command `optimum-cli export openvino --model Qwen/Qwen2.5-VL-3B-Instruct Qwen2.5-VL-3B-Instruct\INT4 --weight-format int4` I tried inferring the quantized model using openvino.genai VLM example and getting the...

Qwen 2.5 VL inference on NPU is not producing any output.

3

I have been trying to do inference of Qwen 2.5 VL 7b model on NPU and it is not giving any output.