Tianhao Cheng
Results
1
issues of
Tianhao Cheng
**Describe the bug** When inference bloom model with `replace_with_kernel_inject = True` , and `dtype = torch.int8` For the reason that this model is trained by torch , I load the...
bug
inference