OpenLLM
OpenLLM copied to clipboard
bug: cannot load local model by model-id
Describe the bug
openllm start thudm/chatglm3-6b --model-id /xxx/xxx/xxx it seems that the code still try to connect huggingfacet to download model.
To reproduce
openllm start thudm/chatglm3-6b --model-id /xxx/xxx/xxx
Logs
print connection error to huggingface.
it is true for that i cannot get access to it for some network permisson.
Environment
openllm 0.4.41
System information (Optional)
No response