aphrodite-engine icon indicating copy to clipboard operation
aphrodite-engine copied to clipboard

[New Model]: GLM-4-0414

Open fizzAI opened this issue 9 months ago • 0 comments

The model to consider.

https://huggingface.co/THUDM/GLM-4-32B-0414, etc

The closest model Aphrodite already supports.

https://github.com/aphrodite-engine/aphrodite-engine/blob/main/aphrodite/modeling/models/chatglm.py Also already in vLLM https://github.com/yangw-dev/vllm/blob/main/vllm/model_executor/models/glm4.py

What's your difficulty of supporting the model you want?

Not really anything big, as long as porting models is still effectively fixing imports in the vLLM implementations

fizzAI avatar Apr 23 '25 13:04 fizzAI