chao
chao
Is the document not up to date?
尝试在package.json中添加string-width依赖，但是会接着缺少别的依赖，是我用的nodejs版本太高？
v0.6.5 build and install success but run model qwq 32b awq and gguf failed
(aphroditenew) root@epyc:~# aphrodite run ~/windows/modelscope/QwQ-32B-AWQ/ --max-model-len 8192 --served-model-name aphrodite INFO: The model is convertible to awq_marlin during runtime. Using awq_marlin kernel. WARNING: awq_marlin kernels are temporarily disabled, they will be...
> you need to set `APHRODITE_TARGET_DEVICE="rocm"` also make this change in your CMakeLists https://github.com/aphrodite-engine/aphrodite-engine/pull/1387/files thanks for your help, I will have a try later.
最新版本v0.10.2也有此问题 当输入达到32K的下一个阶段64K左右就会报错 4卡v100运行30b 32b好像都会报这个错误，还有gpt oss 20b 2025-11-24 09:04:56,205 - lmdeploy - ERROR - async_engine.py:710 - [safe_run] exception caught: CancelledError Cancelled via cancel scope 7f071f010860 by 2025-11-24 09:04:56,205 - lmdeploy -...