Oppo Kui
Results
3
comments of
Oppo Kui
I met the same problem when running vicuna-33b model, not problem with vicuna-13b.
It works! But meet one problem when uploading a txt file for similarity search. I use the script to start vllm engine remotely: ``` pip install git+https://github.com/vllm-project/vllm.git pip install fschat...
Oh, I realized the error is related to openai.com access. I can't access it in local machine, let me retry it in AWS instance.