bing0037
hello, 都5月份了，pdf出来了咩，我来催更啦啦啦啦
here are my steps to add lora to deepspeed model: 1) copy lora.py to your own codebase: [lora.py](https://github.com/microsoft/DeepSpeedExamples/blob/master/applications/DeepSpeed-Chat/training/utils/module/lora.py) 2) add LoRA to your own model: ``` model = BigModel() #...
> @bing0037, did you verify that those paths are valid in both containers? **Thanks for your reply.** # Here are all my tests and results: ## Test 1: test docker...
@tjruwase hi, do you have any suggestions?
Same question. Could you provide the **best result** with LLaMA 1 or LLaMA2 on Vicuna and give the **hyperparameters** (num of epoch/learning rate/lora_r/batch_size)? I wanna reproduce your result ans use...
@little51 Could you please provide any information?