hua zhang

use cmd : python -m vllm.entrypoints.openai.api_server --model /home/centific/hua-project/models/01ai/Yi-34B-Chat-4bits , RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)`

2

(vllm) centific@centific-System-Product-Name:~/hua-project/vllm$ python -m vllm.entrypoints.openai.api_server --model /home/centific/hua-project/models/01ai/Yi-34B-Chat-4bits INFO 12-04 10:05:22 api_server.py:704] args: Namespace(host=None, port=8000, allow_credentials=False, allowed_origins=['*'], allowed_methods=['*'], allowed_headers=['*'], served_model_name=None, chat_template=None, response_role='assistant', model='/home/centific/hua-project/models/01ai/Yi-34B-Chat-4bits', tokenizer=None, revision=None, tokenizer_revision=None, tokenizer_mode='auto', trust_remote_code=False, download_dir=None, load_format='auto', dtype='auto',...

OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like LinkSoul/Chinese-Llama-2-7b is not the path to a directory containing...

使用docker运行后出现docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

更新后，导出模型去哪了？

1

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction 之前的导出命令不管用了 ### Expected behavior _No response_ ### System Info _No response_ ### Others _No...

[Bug]: deploy Phi-3-mini-128k-instruct AssertionError

4

### Your current environment PyTorch version: 2.3.0+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build PyTorch: N/A OS: Ubuntu 22.04.1 LTS (x86_64) GCC version:...

Request failed with status code 502

6

登陆页面显示502，输入账号密码点击登录也没用 

An error occurred while running finetune.py or generate.py

3

发生异常: ValueError Can't read templates/alpaca.json File "/home/ww/alpaca-lora-hua/alpaca-lora/utils/prompter.py", line 20, in __init__ raise ValueError(f"Can't read {file_name}") File "/home/ww/alpaca-lora-hua/alpaca-lora/finetune.py", line 91, in train prompter = Prompter(prompt_template_name) File "/home/ww/alpaca-lora-hua/alpaca-lora/finetune.py", line 283, in fire.Fire(train)...