Flowise icon indicating copy to clipboard operation
Flowise copied to clipboard

[FEATURE] support ollama multimodal

Open Eyalm321 opened this issue 1 year ago • 0 comments

Describe the feature you'd like Right now, to have the llm recognize an image we have to use expansive apis, please support base64 image, Its already support behind the scenes by langchain. basically all we have to do to get this functionality is llm.generate(baseUrl, { images: ["base64_string"]}) and it will work with llava model, I tried node script with langchain seems easy enough to implement Ollama Llava Tool or Adjust the legacy ollama for it

Additional context Add any other context or screenshots about the feature request here.

Eyalm321 avatar Aug 28 '24 07:08 Eyalm321