Shamepoo
Shamepoo
After downsampling, the length of the sequence has been shortened. But how can I return the sequence to its original length since I may need to do sentence generation in...
INFO: 172.16.80.35:48532 - "POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error ERROR: Exception in ASGI application Traceback (most recent call last): File "/home/bigdata/anaconda3/envs/vllm/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 411, in run_asgi result = await app(...
## Requirements Installation Issue ### System Information - **Operating System**: Ubuntu 20.04 - **Python Version**: 3.10.12 - **Virtual Environment**: Yes ### Installation Method ```bash # Please paste the exact command...