DotIN13 issues

Repositories
Issues
Comments

Results 1 issues of


                                            DotIN13

Fix #159

This pull request fixes the TypeError when doing inference with [moss-moon-003-sft-int4](https://huggingface.co/fnlp/moss-moon-003-sft-int4), specifically,`TypeError: ' Union[Tuple[torch.Tensor], Optional[Tuple[torch.Tensor, Tuple[torch.FloatTensor │ │ 268 │ │ residual = hidden_states │ │ 269 │ │ hidden_states...