Zhivar comments

Repositories
Issues
Comments

Results 4 comments of


                                            Zhivar

RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False.

I have the same error as well. I train my model on a GPU, but no matter what I do when storing its weights and parameters, when loading, the error...

Error running `example_chat_completion.py` on `llama-2-7b-chat`

I have the same issue. I tried reducing the batch_size, but it's not helping.

Error running `example_chat_completion.py` on `llama-2-7b-chat`

I could fix my issue using lower max_seq_len. hope this helps.

Error running `example_chat_completion.py` on `llama-2-7b-chat`

I was using 512, which was throwing the error; with 256, it's working fine. Also, note that you can limit the number of prompts you have in the input. In...