ollama-python icon indicating copy to clipboard operation
ollama-python copied to clipboard

ollama-python outputs sometimes half tokens. original ollama works fine in my system

Open binodil opened this issue 1 year ago • 0 comments

Hi there,

I was playing around with ollama-python in jupyter notebook. I have created small HTML form to show dynamic results of the model. In the result, I see some words consists of two tokens or even more. In the image below:

  • The word (CE O) -> CEO;
  • (Th ink) -> Think;
  • (D iffer ently) -> Differently
image

This kind of behaviour does noto appear in the ollama (the same model) in terminal Screen shot of Ollama in terminal image

Looking forward to hearing from you!

binodil avatar May 02 '24 08:05 binodil