YuHe
YuHe
I have the similar issue, I deploy my self host, after first client sync, all client except first fail, I have checked session and key, and they all the same.
我这边在colab上跑给的colab.notebook的时候, 在最后一步也报了 ``` [/content/BELLE/gptq/quant.py](https://localhost:8080/#) in forward(self, x) 259 quant_cuda.vecquant3matmul(x, self.qweight, y, self.scales, self.qzeros, self.groupsize) 260 elif self.bits == 4: --> 261 quant_cuda.vecquant4matmul(x, self.qweight, y, self.scales, self.qzeros, self.groupsize) 262 elif self.bits...