lywinged
lywinged
Yah, that's the "replace" and "copy" path issue, you can add _[[NSFileManager defaultManager] removeItemAtPath:targetPath error:NULL];_ before the _BOOL success = [[NSFileManager defaultManager] copyItemAtPath:path toPath:targetPath error:&error];_ in the OVModuleManager.mm.
need updates....
What's your bitsandbytes version?
> What's your bitsandbytes version?你的bitsandbytes版本是什么？ > Name: bitsandbytes > Version: 0.38.1 uninstall then try bitsandbytes==0.37.2 ？
bitsandbytes==0.37.2 failed? Use 2 x 80G
> I can describe mine, the train loss goes down from 2.5 to 0.1 in epoch 10, while validation loss goes down to 1.15 at epoch 5, and after it...
UPDATED: Vim your python path /site-packages/peft/utils/save_and_load.py, and comment# the "to_return = {k: v for k, v in to_return.items() if (("lora_" in k and adapter_name in k) or ("bias" in k))}"...
> Why don't we set adapter_name from now on to avoid tweaking lib code? > > Defaut name from current peft lib is `adapter_name="default"` just adding this at training end...
> > UPDATED: > > Vim your python path /site-packages/peft/utils/save_and_load.py, and comment# the "to_return = {k: v for k, v in to_return.items() if (("lora_" in k and adapter_name in k)...
Your log was saying your tokenizer doen't seem to work fine. Because your input sentence first went to attention mask and failed. It means the tokenizer can't even convert it...