duongmn89
duongmn89
> I can confirm that tag-based enabling-disabling overrides the `enabled` field of each rules. The same goes for rules disabled with `-D`. I was assuming this to be intended behavior....
> I solved the problem, using the 10-2 version of the Dockerfile, Upgrade base ubuntu to jammy-20230605 Then repackage the image and you can use it Thanks, your solution worked...
> `--kv-transfer-config '{"kv_connector":"LMCacheConnectorV1", "kv_role":"kv_both"}'` Thanks, but I also tried that option and still got the same issue
Yes vllm didn't loop when I didn't use lmcache integration. And I understand that I need to adjust Lmcache size, but my question is that vllm seem loop in my...
Oh that's where the problem come from It loops forever, I waited for about 30 minutes and vllm didn't answer the queries from long_doc_qa.py (only can answer first 4 queries)....
Thanks, can't wait to test it again.
@sammshen hi I installed the new version of lmcache (0.3.10.post2) that contain your PR But this time I have new error of lmcache, should I paste it here or open...