OpenLLM icon indicating copy to clipboard operation
OpenLLM copied to clipboard

bug: cannot load local model by model-id

Open LCorleone opened this issue 2 years ago • 0 comments

Describe the bug

openllm start thudm/chatglm3-6b --model-id /xxx/xxx/xxx it seems that the code still try to connect huggingfacet to download model.

To reproduce

openllm start thudm/chatglm3-6b --model-id /xxx/xxx/xxx

Logs

print connection error to huggingface.
it is true for that i cannot get access to it for some network permisson.

Environment

openllm 0.4.41

System information (Optional)

No response

LCorleone avatar Dec 20 '23 05:12 LCorleone