xsx1001

Convert .pth of lava-phi3-lora failed

3

I finetuned llava-phi3 model with lora, but when I try to convert the resulting weight, an error occurred. This I my command: xtuner convert pth_to_hf ./my_configs/llava_phi3_mini_qlora_clip_vit_large_p14_336_lora_e1_gpu8_finetune_copy.py /mnt/xushixiong/outputs/xtuner/work_dirs/llava_phi3_mini_qlora_clip_vit_large_p14_336_lora_e1_gpu8_finetune_copy/iter_17920.pth/mp_rank_00_model_states.pt ./outputs/sf_0604_xtuner  The...

how can I continue fine-tuning the model after SFT on my own data

2

Thanks for this awesome repo, and I am wandering how to continue fine-tune the model after SFT on my only data. Like the fintune_task_lora.sh in the official llava?