JieShen
JieShen
```bash "do_sample": false, "temperature": 0.0, "top_p": 0, "n": 1, "max_tokens": 128, "stream": false, "stop": "" ``` 我在API 请求中，设置了 stop， 也是没有生效；直到达到了模型生成的最大长度后，才停止生成。
因为论文就是他写的
> 免费的赢跑不起来，，，得要付费的普通GPU+高RAM才可以 Colab Pro 可以满足本项目的需求吗？Colab Pro+太贵了
`pip install numpy==1.21.0`
I use the following command to solve this issue: ```bash pip install "vllm>=0.4.3,
> I also have same problem. However 0.5.4 is not work for me. And "AssertionError: The installed `transformers` version doesn't support ulysses patch. Please install a version between 4.45.0 and...