kaijieJiao comments

Results 5 comments of


                                            kaijieJiao

ImportError: cannot import name 'prepare_model_for_kbit_training' from 'peft' on bash scripts/generate.sh failed with bash scripts/generate.sh

> you need to install the github version of peft with `pip install git+https://github.com/huggingface/peft` sovled it!

generate.py "NotImplementedError: Cannot copy out of meta tensor; no data!"

hello，do you solve it? I meet the same error as your@Wolfscowl

[Usage] Dataloader in train code maybe wrong.

> ### Describe the issue > Issue: Dataloader in train code maybe wrong. > > Command: > > ``` > deepspeed train.py \ > --deepspeed scripts/zero2.json \ > --model_name_or_path "LLaVA-VL/vicuna-7b-v1.3"...

[Usage] Dataloader in train code maybe wrong.

> > ### Describe the issue > > Issue: Dataloader in train code maybe wrong. > > Command: > > ``` > > deepspeed train.py \ > > --deepspeed scripts/zero2.json...

[Usage] Dataloader in train code maybe wrong.

> @kaijieJiao > > ``` > def make_supervised_data_module(tokenizer: transformers.PreTrainedTokenizer, > data_args) -> Dict: > """Make dataset and collator for supervised fine-tuning.""" > dataset_cls = LazySupervisedDataset > > > # concat...