jtwolfe
jtwolfe
the rocm docker image does appear to load the model however there is a grpc error that I have encountered that causes the call to terminate before inference, i am...
> Im trying to work on the hipblas version but I am confused on where the Dockerfiles are located that are used to generate the latest images such as "quay.io/go-skynet/local-ai:master-hipblas"...
> the rocm docker image does appear to load the model however there is a grpc error that I have encountered that causes the call to terminate before inference, i...
> > the rocm docker image does appear to load the model however there is a grpc error that I have encountered that causes the call to terminate before inference,...
@Expro take a look at my previous posts, maybe they will help you solve this, ping me if you like, maybe I can help
@mudler before i spend the time, are there any immediate plans for expanded k8s docs or AMD specific docs?
> > @mudler before i spend the time, are there any immediate plans for expanded k8s docs or AMD specific docs? > > Hey @jtwolfe , thanks for deep diving...
@derzahla last question first: - im pretty sure all of the image configurations are set in the `github actions` `workflows` in the repo im more of a gitlab ci guy...
@derzahla I think there might be some reduced featureset for igpu (my bets on memory adjacent) that is a bit of a sticking point atm in drivers. news was that...
@derzahla i apologize but I was incorrect there is still an issue with SD i see in my testing it appears that as I was testing the aio models i...