Asory

How do i stop the ai from talking to itself??

5

It sometimes just talks to itself for example: ###Human: Hi ###Assistant: Hello, how can i assist you? (i am runing the latest release with vicuna mode)

ModuleNotFoundError: No module named 'prompt_toolkit'

3

it show this error: ModuleNotFoundError: No module named 'prompt_toolkit' but when i run pip install prompt_toolkit or pip install -U prompt-toolkit it say: Requirement already satisfied: prompt_toolkit in c:\users\asser\miniconda3\lib\site-packages (3.0.38)...

Wizardllm Model Does not let user type after first prompt

1

for example i tell it: User: hi AI: hello then the cmd goes blank (as if it is pressing enter to start a new line of text)

VERY VERY Slow on the rtx 4050 and i5-12455 and 16 gb ram

4

I also have cublas enabled and i have tried both 13b and 7b models and it takes ages to even spell on token. I am using these parameters: main -i...

Wizard Coder 15b Support?

9

I have tried running the GGML version of it but it gives this error: main -i --interactive-first -r "### Human:" --temp 0 -c 2048 -n -1 --repeat_penalty 1.2 --instruct --color...