jianweimama

Results 3 comments of jianweimama

自编译的 fastdeploy_python-1.0.7-py3.10-linux-x86_64 使用 openvino 作为backend 报错, paddle, ort 工作正常

补充一下: 对于 AI model 我使用的还是 paddle 格式, 如果使用转成 OV 的IR 格式, 直接报错: FastDeploy/examples/vision/ocr/PP-OCR/cpu-gpu/python# python infer.py --det_model ch_PP-OCRv3_det_infer_ov --cls_model ch_ppocr_mobile_v2.0_cls_infer_ov --rec_model ch_PP-OCRv3_rec_infer_ov --rec_label_file ppocr_keys_v1.txt --image kt.png --device cpu --backend openvino Traceback...

non-singleton dimension errors when run Deepspeed-AutoTP

After rollback BigDL and IPEX-LLM to version 0619, this problem disappeared.

non-singleton dimension errors when run Deepspeed-AutoTP

thanks a lot, will try it soon.