Josh Cohen comments

Results 2 comments of


                                            Josh Cohen

thanks for the update :)

Hi, Is there a reason why on quantization gptq-marlin and awq-marlin there is no optimal config for MOE on Mixtral? @ElizaWszola @dsikka thanks :)