ollama-python
ollama-python copied to clipboard
ollama-python outputs sometimes half tokens. original ollama works fine in my system
Hi there,
I was playing around with ollama-python in jupyter notebook. I have created small HTML form to show dynamic results of the model. In the result, I see some words consists of two tokens or even more. In the image below:
- The word (CE O) -> CEO;
- (Th ink) -> Think;
- (D iffer ently) -> Differently
This kind of behaviour does noto appear in the ollama (the same model) in terminal
Screen shot of Ollama in terminal
Looking forward to hearing from you!