FutureProofHomes

Results 23 comments of FutureProofHomes

Conda is still blocking me from completing the build, even after modifying my Dockerfile per @i11 recommendation. Any tips? ![image](https://github.com/mudler/LocalAI/assets/155350996/52c95d9a-2069-4b58-a846-111f14e2b40b) Here is my docker-compose file: ``` version: '3.6' services: api:...

Ditto: ![image](https://github.com/mudler/LocalAI/assets/155350996/3d53025c-f168-4d77-9018-4a01e86482a5) This issue is also being discussed [here as well](https://github.com/mudler/LocalAI/issues/1315).

@mudler any updates on running LocalAI within Docker on Jetson Orin? Many thanks! ``` jetson@ubuntu:~/Developer/LocalAI$ docker compose up -d --pull always [+] Running 0/1 ⠇ local-ai Pulling 0.9s no matching...

Thanks for the tips everyone. I really want/need to get this up and running inside a container. I'm gonna keep plugging away and if I pull this off I'll share...

Okay, I set my `Dockerfile` to only build core and the container runs perfectly, but only powered by Jetson's CPU (no GPU). ``` ARG IMAGE_TYPE=core ``` By the way, will...

> Just asking: You have the nvidia docker parts done and all that? @ToeiRei, I have successful run stable diffusion and llama.cpp from https://github.com/dusty-nv/jetson-containers repo, so I think I have...

FYI - this is the same issue I'm having: https://github.com/mudler/LocalAI/discussions/601.

Another bit of info: ![image](https://github.com/mudler/LocalAI/assets/155350996/536eefb1-0cf4-4a3e-8cf7-5d4f7ae43d64)

Figured it out. I needed to add the following to my bash profile. Then rebuilt the container with no cache. ``` export PATH=/usr/local/cuda/bin${PATH:+:${PATH}} export LD_LIBRARY_PATH=/usr/local/cuda/lib64\ ${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}} ``` ![image](https://github.com/mudler/LocalAI/assets/155350996/10e3c26e-1d9d-44c4-b648-81ad463bf422)

Disregard the above. I did NOT figure it out. The hunt continues. Same error. WTH! ``` docker logs -f localai-api-1 go mod edit -replace github.com/nomic-ai/gpt4all/gpt4all-bindings/golang=/build/sources/gpt4all/gpt4all-bindings/golang go mod edit -replace github.com/donomii/go-rwkv.cpp=/build/sources/go-rwkv...