Tulipdu

地图经常会飘 显卡为1050 4GB。经常飘回 蒙德风地 或者 地下 矿洞DLC

cant import awq

7

### from the new version，I build it but I cant import awq, - transformers 4.43.3 - torch 2.3.1 - torchaudio 2.4.0 - torchvision 0.19.0 - autoawq 0.2.6 - autoawq_kernels 0.0.7...

inference qwen2 model ,The reasoning is garbled and ValueError: Pointer argument (at 0) cannot be accessed from Triton (cpu tensor?)

1

### 🐛 Describe the bug when I load model with AutoLigerKernelForCausalLM ,I get ValueError: Pointer argument (at 0) cannot be accessed from Triton (cpu tensor?) when load mdoel Apply Model-Specific...

Use vllm engin for eval

3

Hi,How to use vllm engin for eval? [Here](https://github.com/intel/auto-round/blob/main/docs/step_by_step.md#5-evaluation) say add --vllm，but I get : auto-round: error: unrecognized arguments: --vllm) so How to use vllm engin for eval? auto_round Version: 0.9.0...

VLLM LMCache Hang with PD && TP >1

1

**Label** Please label your issue with "bug" and any other relevant labels so that it can easily be easily categorized under [LMCache Onboarding](https://github.com/LMCache/LMCache/issues/1882) **Describe the bug** A clear and concise...