remichu
remichu
Hi, just want to pop by and see how it is going. Will this feature be released soon? If there is some dev branch i can try it as well.
i am encountering this error too. Appreciate if there can be any help
i am wondering the same
By hang i mean, the terminal just kinda not responding. I cant not kill it by ctrl+c but need to force close the terminal. If you have any idea on...
I streamed the token and see what under the hood then turn out, hang just mean the generation is very very slow under certain prompt. I track the len of...
You can refer to my issue created on exllamav2 git hub also. I closed the issue but seems like no solution at the moment
Thank you for the comment. Let me try that revision and update
Langchain is too confusing for me and lately they doesnt seems to care about open model much. Most of their examples and docs are with other paid services. This is...