fsdp_qlora icon indicating copy to clipboard operation
fsdp_qlora copied to clipboard

train.py

Open mylesgoose opened this issue 1 year ago • 1 comments

I had to vary this code here in the Train.py to get it to work on my system

LoRA and DORA modules

sys.path.append("./scripts") from scripts.lora import LORA from scripts.dora import BNBDORA, HQQDORA, DORALayer, MagnitudeLayer

probably because i already had a module called dora and lora in the pip.

mylesgoose avatar Apr 26 '24 13:04 mylesgoose

this fixed the problem for me too, you probably saved me a week of mindless scanning and screaming at AIs

MizuleGPT avatar Jun 04 '24 15:06 MizuleGPT