Please fill this field

performing finetune on top of mini-gemini-8x7b-HD

6

when performing finetune on top of the minigemini-8x7b-HD model using the following config: ``` #!/bin/bash PRETRAIN_NAME=Mini-Gemini-8x7B-Pretrain FINETUNE_NAME=Mini-Gemini-8x7B-HD AUX_SIZE=1536 IMAGE_GRID=2 IMAGE_GLOBAL=True LR_MULTI="model.mm_projector:2,model.vlm_uni:2" # delete --hostfile hostfile_4 and change --per_device_train_batch_size if trained...

I am currently facing an issue with the fine-tuning process of the Mini-Gemini-8x7B architecture. Despite setting up the model for fine-tuning as per the standard configurations and ensuring all steps...

You are using a model of type mini_gemini_mixtral to instantiate a model of type mini_gemini. This is not supported for all configurations of models and can yield errors.

1

I managed to finetune the mini-gemini mixtral model, however post finetuning I am unable to infer with the model. I tried to launch a model worker per described on the...

Fix model name checking