Someguitarist

I'm on Ubuntu 22 LTS and I get the same error: 2:46PM DBG GRPC Service for open-llama-7b-q4_0.bin will be running at: '127.0.0.1:44099' 2:46PM DBG GRPC Service state dir: /tmp/go-processmanager1917593952 2:46PM...

I had figured my error out. It still says that it can't connect, but you can ignore that. My issue was that there wasn't all four files available for the...

There was another integration that did that; it has the model output the request in JSON, and it used it's own integration in order to take the json request and...

+1 to returning it to the way the old HACS integration worked. Sending the automower to the base and starting again used to work great, doesn't work now. Pausing for...

Hi, I'm close to where you're at and would like to help solve this issue, but I'm stuck one step before you. I'm currently using Text-generation-web-ui with the OpenAI extension....

Actually, I just found a mess of logs in my text-generation when I try to use it. It looks like the main complaint is 'functions is not supported'. Any idea...

Man, sorry to post like three times in a row, but for anyone else running into this issue it just seems like text-generation-webui's openai extension doesn't support functions. Either gotta...

Thanks, I'm debating going over to LocalAI, but I really like the gui for the text-based one. Unfortunately I can't get far enough to tell you if I have that...

I don't want to derail this from your original issue, but are you running an Nvidia gpu and mind sharing a docker-compose with a GPTQ model? I've been messing around...

Okay, sorry, now that I've had my temper tantrum I'm just runnung LocalAI on the CPU terribly slowly, but at least for proof of concept. How do you get to...