H2O icon indicating copy to clipboard operation
H2O copied to clipboard
verified publisher icon FMInference

Fix RotaryEmbedding import in modify_gptneox

Open benja-matic opened this issue 1 year ago • 0 comments

rename RotaryEmbedding -> GPTNeoXRotaryEmbedding in utils_hh/modify_gptneox.py

This fixes the error ImportError: cannot import name 'RotaryEmbedding' from 'transformers.models.gpt_neox.modeling_gpt_neox' encountered in run_text_generation.py.

This also updates the readme install instructions to specify transformers version 4.33, as this relates to several open issues:

  • https://github.com/FMInference/H2O/issues/42
  • https://github.com/FMInference/H2O/issues/38
  • https://github.com/FMInference/H2O/issues/25

benja-matic avatar Jul 25 '24 21:07 benja-matic