Pritham Sriram Govindaraj

[Usage] TypeError: LlavaLlamaForCausalLM.__init__() got an unexpected keyword argument 'attn_implementation'

16

### Describe the issue Issue: Getting an error when trying to finetune the LLaVA-v1.6-34b Command: ``` PASTE THE COMMANDS HERE. ``` #!/bin/bash deepspeed LLaVA/llava/train/train_mem.py \ --deepspeed LLaVA/scripts/zero3.json \ --model_name_or_path liuhaotian/llava-v1.6-34b...

This PR aims to fix the following 3 flaky test cases: com.github.roroche.plantuml.BuildClassDiagramTaskTest.produceTests com.github.roroche.plantuml.diagrams.ClassDiagramTest.produceTests com.github.roroche.plantuml.diagrams.PrintDiagramTest.produceTests I found and confirmed the flaky behavior using an open-source research tool [NonDex](https://github.com/TestingResearchIllinois/NonDex), which shuffles implementations...

LLava train stops in middle

1

Hi I was trying to finetune LLaVA using the [official dataset](https://huggingface.co/datasets/liuhaotian/LLaVA-Instruct-150K/tree/main) I used the following command for finetuning: ``` xtuner train llava_v15_13b_finetune_lora --deepspeed deepspeed_zero2 ``` Unfortunately, the process abruptly and...