Sparetavns

Results 4 comments of Sparetavns

ValueError: Asking to pad but the tokenizer does not have a padding token. Please select a token to use as `pad_token` `(tokenizer.pad_token = tokenizer.eos_token e.g.)` or add a new pad token via `tokenizer.add_special_tokens({'pad_token': '[PAD]'})`.

Getting same issue ValueError: Asking to pad but the tokenizer does not have a padding token. Please select a token to use as `pad_token` `(tokenizer.pad_token = tokenizer.eos_token e.g.)` or add...

When finetune the 7b model, I get runtime error: The size of tensor a (65537024) must match the size of tensor b (262148096)

@Arain-sh - it is resolved now ? do you know the root cause ?

RuntimeError: CUDA error: device-side assert triggered when running Llama on multiple gpus

Able to fixed this using below 1. run nvidia-smi command and check GPU IDs, in my case its 0,1,2,3, please check MIG should not be enabled , otherwise that GPU...

Sytem requirements(CPU/GPU,RAM,disk)?

Hi , Can anyone please share system requirement ?