Asory
Asory
When would it be supported????
> Add the -t parameter to your prompt, perhaps -t 4. > > You might try lowering the batch # for the model to begin responding quicker with -b 10...
> Run `top` or `atop` to see how many threads are active on your CPU. As a rough rule of thumb you want to set `-t` to the number of...