hangzeli08

Results 8 comments of


                                            hangzeli08

单机多卡训练方法

it works! thankyou~

指令精调的脚本scripts/run_clm_sft_with_peft.py 说明中有这个文件，但是项目里没有这个文件

师兄，请问大概啥时候～

Fine-tuning InstructBLIP?

same question

If I want to finetune based on your checkpoint with lora，which one should I use？[mplug-owl-llama-7b-ft] or [mplug-owl-llama-7b] ？

请问如果我想在您的微调后的预训练节点上进行继续微调，使用lora的方式，我应该用哪个checkpoint节点，mplug-owl-llama-7b-ft 还是mplug-owl-llama-7b ？

How to do the training on multiple images or image pair data?

请问解决了吗，我也遇到了loss=nan这个问题

How to do the training on multiple images or image pair data?

我和他遇到了一样的问题，在你们的数据集上，loss不为nan，在自己的数据集上，loss为nan

Questions about training related to NCCL

I meet same question

Questions about training related to NCCL

Do you have solve it? Could you share your method？