k8sgpt operator not reaching the LocalAI service

[wmashal]

Discussed in https://github.com/go-skynet/LocalAI/discussions/470

^{Originally posted by wmashal June 1, 2023} Hi

The k8sgpt operator not reaching the LocalAI , I am using v0.3.4 and the enableAI is true but still see the following errors in the k8gpt deployment and operator unless the LocalAI is up and running

As you see I have the baseURL but also the operator still complaining

Please Advice

[Aisuko]

hi @wmashal, please make sure you create a service for localAI pods. And here is tutorials that may help you out. https://itnext.io/k8sgpt-localai-unlock-kubernetes-superpowers-for-free-584790de9b65

[wmashal]

@Aisuko yes I am sure I have the service

[eyalsofer]

Hi @wmashal, im facing the same issue. i think you should update the localai configuration in the k8sgpt-config.yaml: model: ggml-gpt4all-j instead of model: ggml-gpt4all-j.bin. i opened an issue to k8sgpt and theyupdated the controller config for localai: https://github.com/k8sgpt-ai/k8sgpt-operator#installation. here is my open issue: https://github.com/k8sgpt-ai/k8sgpt-operator/issues/141 im still stuck with it.

[TylerGillson]

@wmashal I validated K8sGPT + LocalAI yesterday, so I don't think there is any problem on the LocalAI side. Also, this issue duplicates https://github.com/k8sgpt-ai/k8sgpt-operator/issues/132.

Let's keep the discussion to the issue in the K8sGPT repo. Feel free to ping me in the K8sGPT community Slack and I would be happy to take a look at your env with you.