weiddeng

Anyone fine tuned successfully on 1 or 2 GPUs?

4

I cannot start running the train.py script (on 2 x 4090 gpu) Got this error: File ".../alp/lib/python3.10/site-packages/transformers/hf_argparser.py", line 341, in parse_args_into_dataclasses raise ValueError(f"Some specified arguments are not used by the...

What is micro_batch_size?

2

A stupid question, I think I know what batch_size is, but what is micro_batch_size and what it is for? Thanks! As in ``` python finetune.py \ --base_model 'decapoda-research/llama-7b-hf' \ --data_path...