Flowise icon indicating copy to clipboard operation
Flowise copied to clipboard

[FEATURE] Llama-cpp embeddings component

Open bsalexto opened this issue 2 years ago • 5 comments

Describe the feature you'd like Add Llama-cpp embeddings component.

Additional context Coupling this feature and other local components (memory, vector stores, ChatLocalAI) would allow a complete local only solutions.

bsalexto avatar Jun 02 '23 19:06 bsalexto

Would be awesome to have this feature!

ill-yes avatar Jun 06 '23 16:06 ill-yes

Looking forward to this feature very much.

owenJiao avatar Jun 07 '23 14:06 owenJiao

with LocalAI embedding node, you can now use llama.cpp embedding model - https://github.com/FlowiseAI/Flowise/pull/300

Docs - https://docs.flowiseai.com/embeddings/localai-embeddings

HenryHengZJ avatar Jun 11 '23 12:06 HenryHengZJ

@HenryHengZJ. Pretty cool. By the way, does LocalAI support any other embedding models, like SentenceTransformers.

owenJiao avatar Jun 12 '23 07:06 owenJiao

Thank you. I will try it out

bsalexto avatar Jun 12 '23 13:06 bsalexto

@HenryHengZJ. Pretty cool. By the way, does LocalAI support any other embedding models, like SentenceTransformers.

you can refer to their model compatibility - https://localai.io/model-compatibility/index.html

will close this issue for now, feel free to open if there is any more question

HenryHengZJ avatar Jun 18 '23 21:06 HenryHengZJ