evo-ai icon indicating copy to clipboard operation
evo-ai copied to clipboard

Support for Custom/Local Hosted LLMs

Open Raphango opened this issue 8 months ago • 2 comments

First, congratulations on your outstanding work! I would greatly appreciate it if you could consider adding support for custom or locally hosted LLMs, such as those served by GPT4ALL or LMStudio. This enhancement would significantly empower the community by reducing reliance on major AI providers...

Raphango avatar May 21 '25 20:05 Raphango

First, congratulations on your outstanding work! I would greatly appreciate it if you could consider adding support for custom or locally hosted LLMs, such as those served by GPT4ALL or LMStudio. This enhancement would significantly empower the community by reducing reliance on major AI providers...

That is for the online application. Haven't tried the github version yet, I don't know if there is any difference .

Raphango avatar May 21 '25 20:05 Raphango

First, congratulations on your outstanding work! I would greatly appreciate it if you could consider adding support for custom or locally hosted LLMs, such as those served by GPT4ALL or LMStudio. This enhancement would significantly empower the community by reducing reliance on major AI providers...

That is for the online application. Haven't tried the github version yet, I don't know if there is any difference .

Tested the current version locally, using the github repo files. The lack of support to Local LLMs is not available as well.... any intentions to provide it someday?

Raphango avatar Jun 10 '25 18:06 Raphango