Do not support for finetuning on only one dataset..

Open yuanrr opened this issue 1 year ago • 1 comments

It seems ./dataset/__init__.py can not support for enabling only one dataset in instruction_data.py... How can I fix this ...

Jun 12 '24 18:06 yuanrr

besides, why i have some unexpected key when loading the model like this:

unexpected_keys=['llama_model.model.layers.0.self_attn.rotary_emb.inv_freq', 'llama_model.model.layers.1.self_attn.rotary_emb.inv_freq', 'llama_model.model.layers.2.self_attn.rotary_emb.inv_freq', 'llama_model.model.layers.3.self_attn.rotary_emb.inv_freq',.....................

Jun 13 '24 01:06 yuanrr