[BUG] Ollama call failed with status code 404: model 'llama3:latest' not found, try pulling it first

Open bozo32 opened this issue 1 year ago • 0 comments

Describe the bug It worked a couple of days ago. Now when I try to call Ollama I get the error Ollama call failed with status code 404: model 'llama3:latest' not found, try pulling it first I'm running ollama locally and on a remote server both work through openwebui and langraph both produce the same error with flowise

To Reproduce

create ollama chat base make sure the URL is correct ask it to work with a model

I had Ollama pull llama3:latest...used the command line for it so I know the model is installed and available

Expected behavior it works

Screenshots If applicable, add screenshots to help explain your problem.

Flow { "nodes": [ { "width": 300, "height": 435, "id": "textFile_0", "position": { "x": 855.0882990758375, "y": 172.90041586989727 }, "type": "customNode", "data": { "id": "textFile_0", "label": "Text File", "version": 3, "name": "textFile", "type": "Document", "baseClasses": [ "Document" ], "category": "Document Loaders", "description": "Load data from text files", "inputParams": [ { "label": "Txt File", "name": "txtFile", "type": "file", "fileType": ".txt, .html, .aspx, .asp, .cpp, .c, .cs, .css, .go, .h, .java, .js, .less, .ts, .php, .proto, .python, .py, .rst, .ruby, .rb, .rs, .scala, .sc, .scss, .sol, .sql, .swift, .markdown, .md, .tex, .ltx, .vb, .xml", "id": "textFile_0-input-txtFile-file" }, { "label": "Metadata", "name": "metadata", "type": "json", "optional": true, "additionalParams": true, "id": "textFile_0-input-metadata-json" } ], "inputAnchors": [ { "label": "Text Splitter", "name": "textSplitter", "type": "TextSplitter", "optional": true, "id": "textFile_0-input-textSplitter-TextSplitter" } ], "inputs": { "textSplitter": "{{recursiveCharacterTextSplitter_0.data.instance}}", "metadata": "" }, "outputAnchors": [ { "name": "output", "label": "Output", "type": "options", "options": [ { "id": "textFile_0-output-document-Document|json", "name": "document", "label": "Document", "type": "Document | json" }, { "id": "textFile_0-output-text-string|json", "name": "text", "label": "Text", "type": "string | json" } ], "default": "document" } ], "outputs": { "output": "document" }, "selected": false }, "selected": false, "positionAbsolute": { "x": 855.0882990758375, "y": 172.90041586989727 }, "dragging": false }, { "id": "ollamaEmbedding_0", "position": { "x": -372.1829453650376, "y": 233.03323797673653 }, "type": "customNode", "data": { "id": "ollamaEmbedding_0", "label": "Ollama Embeddings", "version": 1, "name": "ollamaEmbedding", "type": "OllamaEmbeddings", "baseClasses": [ "OllamaEmbeddings", "Embeddings" ], "category": "Embeddings", "description": "Generate embeddings for a given text using open source model on Ollama", "inputParams": [ { "label": "Base URL", "name": "baseUrl", "type": "string", "default": "http://localhost:11434", "id": "ollamaEmbedding_0-input-baseUrl-string" }, { "label": "Model Name", "name": "modelName", "type": "string", "placeholder": "llama2", "id": "ollamaEmbedding_0-input-modelName-string" }, { "label": "Number of GPU", "name": "numGpu", "type": "number", "description": "The number of layers to send to the GPU(s). On macOS it defaults to 1 to enable metal support, 0 to disable. Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "ollamaEmbedding_0-input-numGpu-number" }, { "label": "Number of Thread", "name": "numThread", "type": "number", "description": "Sets the number of threads to use during computation. By default, Ollama will detect this for optimal performance. It is recommended to set this value to the number of physical CPU cores your system has (as opposed to the logical number of cores). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "ollamaEmbedding_0-input-numThread-number" }, { "label": "Use MMap", "name": "useMMap", "type": "boolean", "optional": true, "additionalParams": true, "id": "ollamaEmbedding_0-input-useMMap-boolean" } ], "inputAnchors": [], "inputs": { "baseUrl": "http://localhost:11435", "modelName": "hellord/e5-mistral-7b-instruct:Q8_0", "numGpu": "", "numThread": "", "useMMap": true }, "outputAnchors": [ { "id": "ollamaEmbedding_0-output-ollamaEmbedding-OllamaEmbeddings|Embeddings", "name": "ollamaEmbedding", "label": "OllamaEmbeddings", "description": "Generate embeddings for a given text using open source model on Ollama", "type": "OllamaEmbeddings | Embeddings" } ], "outputs": {}, "selected": false }, "width": 300, "height": 426, "selected": false, "positionAbsolute": { "x": -372.1829453650376, "y": 233.03323797673653 }, "dragging": false }, { "id": "recursiveCharacterTextSplitter_0", "position": { "x": 476.1764407227737, "y": 195.63140291979607 }, "type": "customNode", "data": { "id": "recursiveCharacterTextSplitter_0", "label": "Recursive Character Text Splitter", "version": 2, "name": "recursiveCharacterTextSplitter", "type": "RecursiveCharacterTextSplitter", "baseClasses": [ "RecursiveCharacterTextSplitter", "TextSplitter", "BaseDocumentTransformer", "Runnable" ], "category": "Text Splitters", "description": "Split documents recursively by different characters - starting with "\n\n", then "\n", then " "", "inputParams": [ { "label": "Chunk Size", "name": "chunkSize", "type": "number", "default": 1000, "optional": true, "id": "recursiveCharacterTextSplitter_0-input-chunkSize-number" }, { "label": "Chunk Overlap", "name": "chunkOverlap", "type": "number", "optional": true, "id": "recursiveCharacterTextSplitter_0-input-chunkOverlap-number" }, { "label": "Custom Separators", "name": "separators", "type": "string", "rows": 4, "description": "Array of custom separators to determine when to split the text, will override the default separators", "placeholder": "["|", "##", ">", "-"]", "additionalParams": true, "optional": true, "id": "recursiveCharacterTextSplitter_0-input-separators-string" } ], "inputAnchors": [], "inputs": { "chunkSize": "300", "chunkOverlap": "50", "separators": "" }, "outputAnchors": [ { "id": "recursiveCharacterTextSplitter_0-output-recursiveCharacterTextSplitter-RecursiveCharacterTextSplitter|TextSplitter|BaseDocumentTransformer|Runnable", "name": "recursiveCharacterTextSplitter", "label": "RecursiveCharacterTextSplitter", "description": "Split documents recursively by different characters - starting with "\n\n", then "\n", then " "", "type": "RecursiveCharacterTextSplitter | TextSplitter | BaseDocumentTransformer | Runnable" } ], "outputs": {}, "selected": false }, "width": 300, "height": 426, "selected": false, "positionAbsolute": { "x": 476.1764407227737, "y": 195.63140291979607 }, "dragging": false }, { "id": "chroma_0", "position": { "x": 1307.8467266763457, "y": 554.8419763755659 }, "type": "customNode", "data": { "id": "chroma_0", "label": "Chroma", "version": 2, "name": "chroma", "type": "Chroma", "baseClasses": [ "Chroma", "VectorStoreRetriever", "BaseRetriever" ], "category": "Vector Stores", "description": "Upsert embedded data and perform similarity search upon query using Chroma, an open-source embedding database", "inputParams": [ { "label": "Connect Credential", "name": "credential", "type": "credential", "description": "Only needed if you have chroma on cloud services with X-Api-key", "optional": true, "credentialNames": [ "chromaApi" ], "id": "chroma_0-input-credential-credential" }, { "label": "Collection Name", "name": "collectionName", "type": "string", "id": "chroma_0-input-collectionName-string" }, { "label": "Chroma URL", "name": "chromaURL", "type": "string", "optional": true, "id": "chroma_0-input-chromaURL-string" }, { "label": "Chroma Metadata Filter", "name": "chromaMetadataFilter", "type": "json", "optional": true, "additionalParams": true, "id": "chroma_0-input-chromaMetadataFilter-json" }, { "label": "Top K", "name": "topK", "description": "Number of top results to fetch. Default to 4", "placeholder": "4", "type": "number", "additionalParams": true, "optional": true, "id": "chroma_0-input-topK-number" } ], "inputAnchors": [ { "label": "Document", "name": "document", "type": "Document", "list": true, "optional": true, "id": "chroma_0-input-document-Document" }, { "label": "Embeddings", "name": "embeddings", "type": "Embeddings", "id": "chroma_0-input-embeddings-Embeddings" }, { "label": "Record Manager", "name": "recordManager", "type": "RecordManager", "description": "Keep track of the record to prevent duplication", "optional": true, "id": "chroma_0-input-recordManager-RecordManager" } ], "inputs": { "document": [ "{{textFile_0.data.instance}}" ], "embeddings": "{{ollamaEmbedding_0.data.instance}}", "recordManager": "", "collectionName": "new", "chromaURL": "", "chromaMetadataFilter": "", "topK": "" }, "outputAnchors": [ { "name": "output", "label": "Output", "type": "options", "description": "", "options": [ { "id": "chroma_0-output-retriever-Chroma|VectorStoreRetriever|BaseRetriever", "name": "retriever", "label": "Chroma Retriever", "description": "", "type": "Chroma | VectorStoreRetriever | BaseRetriever" }, { "id": "chroma_0-output-vectorStore-Chroma|VectorStore", "name": "vectorStore", "label": "Chroma Vector Store", "description": "", "type": "Chroma | VectorStore" } ], "default": "retriever" } ], "outputs": { "output": "retriever" }, "selected": false }, "width": 300, "height": 698, "selected": false, "positionAbsolute": { "x": 1307.8467266763457, "y": 554.8419763755659 }, "dragging": false }, { "id": "webBrowser_0", "position": { "x": 664.0616928946288, "y": -244.75606587710632 }, "type": "customNode", "data": { "id": "webBrowser_0", "label": "Web Browser", "version": 1, "name": "webBrowser", "type": "WebBrowser", "baseClasses": [ "WebBrowser", "Tool", "StructuredTool", "Runnable" ], "category": "Tools", "description": "Gives agent the ability to visit a website and extract information", "inputParams": [], "inputAnchors": [ { "label": "Language Model", "name": "model", "type": "BaseLanguageModel", "id": "webBrowser_0-input-model-BaseLanguageModel" }, { "label": "Embeddings", "name": "embeddings", "type": "Embeddings", "id": "webBrowser_0-input-embeddings-Embeddings" } ], "inputs": { "model": "{{chatOllama_0.data.instance}}", "embeddings": "{{ollamaEmbedding_0.data.instance}}" }, "outputAnchors": [ { "id": "webBrowser_0-output-webBrowser-WebBrowser|Tool|StructuredTool|Runnable", "name": "webBrowser", "label": "WebBrowser", "description": "Gives agent the ability to visit a website and extract information", "type": "WebBrowser | Tool | StructuredTool | Runnable" } ], "outputs": {}, "selected": false }, "width": 300, "height": 278, "positionAbsolute": { "x": 664.0616928946288, "y": -244.75606587710632 }, "selected": false, "dragging": false }, { "id": "conversationalRetrievalQAChain_0", "position": { "x": 1714.303436588928, "y": -307.98327459643264 }, "type": "customNode", "data": { "id": "conversationalRetrievalQAChain_0", "label": "Conversational Retrieval QA Chain", "version": 3, "name": "conversationalRetrievalQAChain", "type": "ConversationalRetrievalQAChain", "baseClasses": [ "ConversationalRetrievalQAChain", "BaseChain", "Runnable" ], "category": "Chains", "description": "Document QA - built on RetrievalQAChain to provide a chat history component", "inputParams": [ { "label": "Return Source Documents", "name": "returnSourceDocuments", "type": "boolean", "optional": true, "id": "conversationalRetrievalQAChain_0-input-returnSourceDocuments-boolean" }, { "label": "Rephrase Prompt", "name": "rephrasePrompt", "type": "string", "description": "Using previous chat history, rephrase question into a standalone question", "warning": "Prompt must include input variables: {chat_history} and {question}", "rows": 4, "additionalParams": true, "optional": true, "default": "Given the following conversation and a follow up question, rephrase the follow up question to be a standalone question.\n\nChat History:\n{chat_history}\nFollow Up Input: {question}\nStandalone Question:", "id": "conversationalRetrievalQAChain_0-input-rephrasePrompt-string" }, { "label": "Response Prompt", "name": "responsePrompt", "type": "string", "description": "Taking the rephrased question, search for answer from the provided context", "warning": "Prompt must include input variable: {context}", "rows": 4, "additionalParams": true, "optional": true, "default": "I want you to act as a document that I am having a conversation with. Your name is "AI Assistant". Using the provided context, answer the user's question to the best of your ability using the resources provided.\nIf there is nothing in the context relevant to the question at hand, just say "Hmm, I'm not sure" and stop after that. Refuse to answer any question not about the info. Never break character.\n------------\n{context}\n------------\nREMEMBER: If there is no relevant information within the context, just say "Hmm, I'm not sure". Don't try to make up an answer. Never break character.", "id": "conversationalRetrievalQAChain_0-input-responsePrompt-string" } ], "inputAnchors": [ { "label": "Chat Model", "name": "model", "type": "BaseChatModel", "id": "conversationalRetrievalQAChain_0-input-model-BaseChatModel" }, { "label": "Vector Store Retriever", "name": "vectorStoreRetriever", "type": "BaseRetriever", "id": "conversationalRetrievalQAChain_0-input-vectorStoreRetriever-BaseRetriever" }, { "label": "Memory", "name": "memory", "type": "BaseMemory", "optional": true, "description": "If left empty, a default BufferMemory will be used", "id": "conversationalRetrievalQAChain_0-input-memory-BaseMemory" }, { "label": "Input Moderation", "description": "Detect text that could generate harmful output and prevent it from being sent to the language model", "name": "inputModeration", "type": "Moderation", "optional": true, "list": true, "id": "conversationalRetrievalQAChain_0-input-inputModeration-Moderation" } ], "inputs": { "model": "{{chatOllama_0.data.instance}}", "vectorStoreRetriever": "{{chroma_0.data.instance}}", "memory": "", "returnSourceDocuments": true, "rephrasePrompt": "Given the following conversation and a follow up question, rephrase the follow up question to be a standalone question.\n\nChat History:\n{chat_history}\nFollow Up Input: {question}\nStandalone Question:", "responsePrompt": "I want you to act as a document that I am having a conversation with. Your name is "AI Assistant". Using the provided context, answer the user's question to the best of your ability using the resources provided.\nIf there is nothing in the context relevant to the question at hand, just say "Hmm, I'm not sure" and stop after that. Refuse to answer any question not about the info. Never break character.\n------------\n{context}\n------------\nREMEMBER: If there is no relevant information within the context, just say "Hmm, I'm not sure". Don't try to make up an answer. Never break character.", "inputModeration": "" }, "outputAnchors": [ { "id": "conversationalRetrievalQAChain_0-output-conversationalRetrievalQAChain-ConversationalRetrievalQAChain|BaseChain|Runnable", "name": "conversationalRetrievalQAChain", "label": "ConversationalRetrievalQAChain", "description": "Document QA - built on RetrievalQAChain to provide a chat history component", "type": "ConversationalRetrievalQAChain | BaseChain | Runnable" } ], "outputs": {}, "selected": false }, "width": 300, "height": 526, "selected": false, "dragging": false, "positionAbsolute": { "x": 1714.303436588928, "y": -307.98327459643264 } }, { "id": "chatOllama_0", "position": { "x": 219.34591196373748, "y": -938.8261832512679 }, "type": "customNode", "data": { "id": "chatOllama_0", "label": "ChatOllama", "version": 2, "name": "chatOllama", "type": "ChatOllama", "baseClasses": [ "ChatOllama", "SimpleChatModel", "BaseChatModel", "BaseLanguageModel", "Runnable" ], "category": "Chat Models", "description": "Chat completion using open-source LLM on Ollama", "inputParams": [ { "label": "Base URL", "name": "baseUrl", "type": "string", "default": "http://localhost:11434", "id": "chatOllama_0-input-baseUrl-string" }, { "label": "Model Name", "name": "modelName", "type": "string", "placeholder": "llama2", "id": "chatOllama_0-input-modelName-string" }, { "label": "Temperature", "name": "temperature", "type": "number", "description": "The temperature of the model. Increasing the temperature will make the model answer more creatively. (Default: 0.8). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 0.1, "default": 0.9, "optional": true, "id": "chatOllama_0-input-temperature-number" }, { "label": "Top P", "name": "topP", "type": "number", "description": "Works together with top-k. A higher value (e.g., 0.95) will lead to more diverse text, while a lower value (e.g., 0.5) will generate more focused and conservative text. (Default: 0.9). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 0.1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-topP-number" }, { "label": "Top K", "name": "topK", "type": "number", "description": "Reduces the probability of generating nonsense. A higher value (e.g. 100) will give more diverse answers, while a lower value (e.g. 10) will be more conservative. (Default: 40). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-topK-number" }, { "label": "Mirostat", "name": "mirostat", "type": "number", "description": "Enable Mirostat sampling for controlling perplexity. (default: 0, 0 = disabled, 1 = Mirostat, 2 = Mirostat 2.0). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-mirostat-number" }, { "label": "Mirostat ETA", "name": "mirostatEta", "type": "number", "description": "Influences how quickly the algorithm responds to feedback from the generated text. A lower learning rate will result in slower adjustments, while a higher learning rate will make the algorithm more responsive. (Default: 0.1) Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 0.1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-mirostatEta-number" }, { "label": "Mirostat TAU", "name": "mirostatTau", "type": "number", "description": "Controls the balance between coherence and diversity of the output. A lower value will result in more focused and coherent text. (Default: 5.0) Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 0.1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-mirostatTau-number" }, { "label": "Context Window Size", "name": "numCtx", "type": "number", "description": "Sets the size of the context window used to generate the next token. (Default: 2048) Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-numCtx-number" }, { "label": "Number of GQA groups", "name": "numGqa", "type": "number", "description": "The number of GQA groups in the transformer layer. Required for some models, for example it is 8 for llama2:70b. Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-numGqa-number" }, { "label": "Number of GPU", "name": "numGpu", "type": "number", "description": "The number of layers to send to the GPU(s). On macOS it defaults to 1 to enable metal support, 0 to disable. Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-numGpu-number" }, { "label": "Number of Thread", "name": "numThread", "type": "number", "description": "Sets the number of threads to use during computation. By default, Ollama will detect this for optimal performance. It is recommended to set this value to the number of physical CPU cores your system has (as opposed to the logical number of cores). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-numThread-number" }, { "label": "Repeat Last N", "name": "repeatLastN", "type": "number", "description": "Sets how far back for the model to look back to prevent repetition. (Default: 64, 0 = disabled, -1 = num_ctx). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-repeatLastN-number" }, { "label": "Repeat Penalty", "name": "repeatPenalty", "type": "number", "description": "Sets how strongly to penalize repetitions. A higher value (e.g., 1.5) will penalize repetitions more strongly, while a lower value (e.g., 0.9) will be more lenient. (Default: 1.1). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 0.1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-repeatPenalty-number" }, { "label": "Stop Sequence", "name": "stop", "type": "string", "rows": 4, "placeholder": "AI assistant:", "description": "Sets the stop sequences to use. Use comma to seperate different sequences. Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "optional": true, "additionalParams": true, "id": "chatOllama_0-input-stop-string" }, { "label": "Tail Free Sampling", "name": "tfsZ", "type": "number", "description": "Tail free sampling is used to reduce the impact of less probable tokens from the output. A higher value (e.g., 2.0) will reduce the impact more, while a value of 1.0 disables this setting. (Default: 1). Refer to <a target="_blank" href="https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values">docs for more details", "step": 0.1, "optional": true, "additionalParams": true, "id": "chatOllama_0-input-tfsZ-number" } ], "inputAnchors": [ { "label": "Cache", "name": "cache", "type": "BaseCache", "optional": true, "id": "chatOllama_0-input-cache-BaseCache" } ], "inputs": { "cache": "", "baseUrl": "http://localhost:11435", "modelName": "llama3:latest", "temperature": 0.9, "topP": "", "topK": "", "mirostat": "", "mirostatEta": "", "mirostatTau": "", "numCtx": "", "numGqa": "", "numGpu": "", "numThread": "", "repeatLastN": "", "repeatPenalty": "", "stop": "", "tfsZ": "" }, "outputAnchors": [ { "id": "chatOllama_0-output-chatOllama-ChatOllama|SimpleChatModel|BaseChatModel|BaseLanguageModel|Runnable", "name": "chatOllama", "label": "ChatOllama", "description": "Chat completion using open-source LLM on Ollama", "type": "ChatOllama | SimpleChatModel | BaseChatModel | BaseLanguageModel | Runnable" } ], "outputs": {}, "selected": false }, "width": 300, "height": 574, "selected": false, "positionAbsolute": { "x": 219.34591196373748, "y": -938.8261832512679 }, "dragging": false } ], "edges": [ { "source": "recursiveCharacterTextSplitter_0", "sourceHandle": "recursiveCharacterTextSplitter_0-output-recursiveCharacterTextSplitter-RecursiveCharacterTextSplitter|TextSplitter|BaseDocumentTransformer|Runnable", "target": "textFile_0", "targetHandle": "textFile_0-input-textSplitter-TextSplitter", "type": "buttonedge", "id": "recursiveCharacterTextSplitter_0-recursiveCharacterTextSplitter_0-output-recursiveCharacterTextSplitter-RecursiveCharacterTextSplitter|TextSplitter|BaseDocumentTransformer|Runnable-textFile_0-textFile_0-input-textSplitter-TextSplitter" }, { "source": "ollamaEmbedding_0", "sourceHandle": "ollamaEmbedding_0-output-ollamaEmbedding-OllamaEmbeddings|Embeddings", "target": "chroma_0", "targetHandle": "chroma_0-input-embeddings-Embeddings", "type": "buttonedge", "id": "ollamaEmbedding_0-ollamaEmbedding_0-output-ollamaEmbedding-OllamaEmbeddings|Embeddings-chroma_0-chroma_0-input-embeddings-Embeddings" }, { "source": "textFile_0", "sourceHandle": "textFile_0-output-document-Document|json", "target": "chroma_0", "targetHandle": "chroma_0-input-document-Document", "type": "buttonedge", "id": "textFile_0-textFile_0-output-document-Document|json-chroma_0-chroma_0-input-document-Document" }, { "source": "ollamaEmbedding_0", "sourceHandle": "ollamaEmbedding_0-output-ollamaEmbedding-OllamaEmbeddings|Embeddings", "target": "webBrowser_0", "targetHandle": "webBrowser_0-input-embeddings-Embeddings", "type": "buttonedge", "id": "ollamaEmbedding_0-ollamaEmbedding_0-output-ollamaEmbedding-OllamaEmbeddings|Embeddings-webBrowser_0-webBrowser_0-input-embeddings-Embeddings" }, { "source": "chroma_0", "sourceHandle": "chroma_0-output-retriever-Chroma|VectorStoreRetriever|BaseRetriever", "target": "conversationalRetrievalQAChain_0", "targetHandle": "conversationalRetrievalQAChain_0-input-vectorStoreRetriever-BaseRetriever", "type": "buttonedge", "id": "chroma_0-chroma_0-output-retriever-Chroma|VectorStoreRetriever|BaseRetriever-conversationalRetrievalQAChain_0-conversationalRetrievalQAChain_0-input-vectorStoreRetriever-BaseRetriever" }, { "source": "chatOllama_0", "sourceHandle": "chatOllama_0-output-chatOllama-ChatOllama|SimpleChatModel|BaseChatModel|BaseLanguageModel|Runnable", "target": "conversationalRetrievalQAChain_0", "targetHandle": "conversationalRetrievalQAChain_0-input-model-BaseChatModel", "type": "buttonedge", "id": "chatOllama_0-chatOllama_0-output-chatOllama-ChatOllama|SimpleChatModel|BaseChatModel|BaseLanguageModel|Runnable-conversationalRetrievalQAChain_0-conversationalRetrievalQAChain_0-input-model-BaseChatModel" }, { "source": "chatOllama_0", "sourceHandle": "chatOllama_0-output-chatOllama-ChatOllama|SimpleChatModel|BaseChatModel|BaseLanguageModel|Runnable", "target": "webBrowser_0", "targetHandle": "webBrowser_0-input-model-BaseLanguageModel", "type": "buttonedge", "id": "chatOllama_0-chatOllama_0-output-chatOllama-ChatOllama|SimpleChatModel|BaseChatModel|BaseLanguageModel|Runnable-webBrowser_0-webBrowser_0-input-model-BaseLanguageModel" } ] } Setup

NPX install just re-installed it today Mac OS X safari, edge, chrome

Additional context from Ollama {"function":"log_server_request","level":"INFO","line":2741,"method":"POST","msg":"request","params":{},"path":"/embedding","remote_addr":"127.0.0.1","remote_port":53946,"status":200,"tid":"0x16f527000","timestamp":1715020605} [GIN] 2024/05/06 - 20:36:45 | 200 | 11.578357208s | 127.0.0.1 | POST "/api/embeddings" [GIN] 2024/05/06 - 20:36:45 | 404 | 1.761625ms | 127.0.0.1 | POST "/api/chat" [GIN] 2024/05/06 - 20:36:45 | 404 | 3.775792ms | 127.0.0.1 | POST "/api/generate"

May 06 '24 18:05 bozo32