petals icon indicating copy to clipboard operation
petals copied to clipboard

replaced call to `_prepare_decoder_attention_mask()` with `_prepare_4d_causal_attention_mask()`

Open poedator opened this issue 2 years ago • 1 comments

fixes issue #536 edited calls to mask methods consistently with https://github.com/huggingface/transformers/pull/27086

poedator avatar Nov 21 '23 22:11 poedator

Hi!

Note: a day ago, we had suspicions that the issue is with the main branch and not this one. It appears not to be the case.

I can confirm that def test_input_ids, specifically, passes in the main branch but fails here. This is most likely a bug. I can look into this eventually, but if you have time, please look into this yourself first.

justheuristic avatar Nov 23 '23 21:11 justheuristic