Xingchao, Zhang comments

Results 4 comments of


                                            Xingchao, Zhang

[Bug]: Phi3 still not supported

+1, Phi-3 still not supported in the main branch even though https://github.com/vllm-project/vllm/pull/4298 is merged

Error while fine-tuning model using example from "examples/finetune.ipynb": `RuntimeError: shape '[8, 129, 12, 512]' is invalid for input of size 8306688`

How u try the latest code base, I don't see ur issue

Error while fine-tuning model using example from "examples/finetune.ipynb": `RuntimeError: shape '[8, 129, 12, 512]' is invalid for input of size 8306688`

@BradyBonnette I changed nothing, neither code base(latest as u show) nor dataset (pipe-mistral-v0.1). I was training the model on a M1 Macbook with below transformers version: `transformers 4.40.2 ` `torch...

Error while fine-tuning model using example from "examples/finetune.ipynb": `RuntimeError: shape '[8, 129, 12, 512]' is invalid for input of size 8306688`

MacBook Pro with M1 Max > Well now I am even more confused 🙃 What hardware are you running on?