transformers icon indicating copy to clipboard operation
transformers copied to clipboard
verified publisher icon huggingface

4.29.0 bug

Open macheng6 opened this issue 2 years ago • 2 comments

System Info

The dp mode of 4.29.0 seems to have a bug. When forwarding, the dtype of the model will be changed to torch.int64, which will cause the torch.finfo function in the get_extended_attention_mask function to report an error

Who can help?

No response

Information

  • [ ] The official example scripts
  • [x] My own modified scripts

Tasks

  • [ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • [x] My own task or dataset (give details below)

Reproduction

no

Expected behavior

no

macheng6 avatar Jun 01 '23 05:06 macheng6

That's why there is the patch 4.29.2

sgugger avatar Jun 01 '23 13:06 sgugger

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Jul 01 '23 15:07 github-actions[bot]