VBWyrde comments

Results 6 comments of


                                            VBWyrde

Trying to Run gpt4all on GPU, Windows 11: RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'

I also got it running on Windows 11 with the following hardware: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz 3.19 GHz and Installed RAM 15.9 GB I used the Visual Studio...

Use offline private LLMs (Llama, Alpaca, Vicuna*, etc.)

This is exactly what I am looking to do myself as well. However, I'm not sure about the technical details of doing so. Can anyone provide a bit of guidance...

Use offline private LLMs (Llama, Alpaca, Vicuna*, etc.)

Ok I will take a look. I don't have my local machine setup yet, but I am getting it tomorrow. Also, just to be clear, I am quite new to...

Budget Manager for LLM(GPT,VertexAI,Falcon,LLama) and others.

I hope I'm not out of place making this suggestion, but since we're talking about predictive models, what would be even nicer, imo, is a predictive cost feature that allows...

Budget Manager for LLM(GPT,VertexAI,Falcon,LLama) and others.

Thanks @krrishdholakia ... If I read that correctly what it does is tell you how much it already cost to run a given prompt after the fact (so it tells...

Budget Manager for LLM(GPT,VertexAI,Falcon,LLama) and others.

Ah, ok, I get ya. Thanks. And yes, I was kind of looking further ahead with my suggestion, for when full blow agents come into play. In those cases, being...