Xiang Ying comments

Repositories
Issues
Comments

Results 4 comments of


                                            Xiang Ying

[BUG] Wrong output for batch input for opt model inference.

any update for this question?

[BUG] Wrong output for batch input for opt model inference.

> @yingapple can you please confirm this is only related to OPT model or you have observed similar issue with other models as well? Could you also please provide us...

[BUG] Wrong output for batch input for opt model inference.

> @yingapple can you please confirm this is only related to OPT model or you have observed similar issue with other models as well? Could you also please provide us...

CUBLAS_STATUS_INTERNAL_ERROR for OPT-13b when input token length > 230 (with generate token length = 20)

I fix the problem by add padding tokens to avoid the specific length. So I'll close the issue.