nehaprakriya comments

Results 3 comments of


                                            nehaprakriya

I have the same error with the Mixtral 8x7B model using 4 A6000 GPUs (48GiB memory per device).

Hi, @Maniues, were you able to resolve this issue? I have the same error.

Thank you for your quick response! I will try changing the model structure and see how it works.