DeepSpeed-MII icon indicating copy to clipboard operation
DeepSpeed-MII copied to clipboard
verified publisher icon microsoft

Issues with llama 2 model example

Open ttim opened this issue 2 years ago • 1 comments

I'm running examples with NousResearch/Llama-2-7b-chat-hf HuggingFace repo and output of the model is gibberish and broken. What can be an issue? Thanks!

ttim avatar Nov 04 '23 03:11 ttim

Hi @ttim I have confirmed that I can replicate this error. I will share an update when we have a solution. Thanks

mrwyattii avatar Nov 06 '23 21:11 mrwyattii