unstract icon indicating copy to clipboard operation
unstract copied to clipboard

fix: [ISSUE]:: Unable to Configure Ollama on localhost:11434 Despite Successful Installation

Open KotapallyHarish opened this issue 11 months ago • 3 comments

Describe the bug

A clear and concise description of what the bug is.

I have completed all the steps mentioned in the documentation to set up the Unstract SDK. However, I am unable to configure Ollama at localhost:11434.

When I run the curl command or try opening http://localhost:11434 in the browser, it confirms that Ollama is running. Despite this, the SDK does not seem to recognize it. Could you please advise if I might be missing any configuration steps?

Steps Taken:

Installed and started Ollama successfully. Verified it is running via curl http://localhost:11434. Followed the setup instructions in the Unstract SDK documentation. Any guidance would be appreciated. Thanks!

To reproduce

Steps to reproduce the behavior.

Expected behavior

A clear and concise description of what you expected to happen.

Environment details

  • Version: [e.g. 0.41.2]

Additional context

Add any other context about the problem here.

Screenshots

If applicable, add screenshots to help explain your problem.

KotapallyHarish avatar Mar 04 '25 11:03 KotapallyHarish

I've run into this same issue when trying to run ollama locally. It looks like it cannot access the unstract docker network. The way I've solved it, is by running the ollama docker container. There's an instruction available on the Unstract blog on how to do this: https://unstract.com/blog/open-source-document-data-extraction-with-unstract-deepseek/. I'm trying to figure out how to connect a local (non-containerized) ollama instance to the unstract docker network, but I haven't had the time to dive into it yet. Hope this helps, @KotapallyHarish

prakkert avatar Mar 17 '25 09:03 prakkert

Please try http://host.docker.internal:11434 instead of http://localhost:11434 its should fix your problem.

muralibisa avatar Mar 27 '25 17:03 muralibisa

I tried even with @htthttp://host.docker.internal:11434/ ; it didn't fix the problem. I then logged into the backend docker container - "unstract-backend" and ran the curl command to http://host.docker.internal:11434/ and the output was "Ollama is runningroot" , meaning docker container is able to connect to the locally run Ollama, still the Unstract isn't able to pick it up.

Can anyone help? Thanks!!

pbirdo-ts avatar Jul 19 '25 07:07 pbirdo-ts