Shailja

Model loading failed for inference - KeyError: 'gpt_bigcode'

4

--------------------------------------------------------------------------- KeyError Traceback (most recent call last) /tmp/ipykernel_1004512/2718782402.py in 2 tokenizer = AutoTokenizer.from_pretrained(checkpoint,use_auth_token=True) 3 # to save memory consider using fp16 or bf16 by specifying torch.dtype=torch.float16 for example ----> 4...

Model Checkpoint NOT saved, Eval Loss "Inf"

3

### System Info torchrun \ --nproc_per_node 3 \ llama_finetuning.py \ --enable_fsdp \ --low_cpu_fsdp \ --use_peft \ --dataset custom_dataset \ --peft_method lora \ --model_name /Llama-2-13b-chat-hf \ --pure_bf16 \ --dist_checkpoint_root_folder /dist_chkpt_root_folder \...