aphrodite-engine
aphrodite-engine copied to clipboard
[New Model]: GLM-4-0414
The model to consider.
https://huggingface.co/THUDM/GLM-4-32B-0414, etc
The closest model Aphrodite already supports.
https://github.com/aphrodite-engine/aphrodite-engine/blob/main/aphrodite/modeling/models/chatglm.py Also already in vLLM https://github.com/yangw-dev/vllm/blob/main/vllm/model_executor/models/glm4.py
What's your difficulty of supporting the model you want?
Not really anything big, as long as porting models is still effectively fixing imports in the vLLM implementations