AttributeError: 'FalconAttention' object has no attribute 'maybe_rotary'

Open luchangli03 opened this issue 1 year ago • 1 comments

OmniQuant-main/models/int_falcon_layer.py", line 52, in init self.maybe_rotary = copy.deepcopy(org_module.maybe_rotary) File "local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1614, in getattr raise AttributeError("'{}' object has no attribute '{}'".format( AttributeError: 'FalconAttention' object has no attribute 'maybe_rotary'

transformers version: 4.39.3

Apr 11 '24 09:04 luchangli03

I encountered the same issue. It seems that the transformers package does not have maybe_rotary. How did you solve this problem later?I tried different versions of the transformers package.

transformers version: 4.32.0

Jun 27 '24 01:06 chaibosong