Liyan Tang

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

76

```python from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-2-7b-chat-hf") model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-chat-hf") inputs = ... inputs = tokenizer.batch_encode_plus(inputs, return_tensors="pt", padding=True) model.generate(**inputs, **generate_kwargs) ``` RuntimeError: probability tensor contains either `inf`, `nan`...

Have you uploaded the annotation guideline?

Add `apply_chat_template` functionality

1

Hi, I realize that there is no `apply_chat_template` implemented for InternVL, which makes it not easy to integrate it into the code base with other models having apply_chat_template defined. Are...

Fine-tune InternVL2 using SFTTrainer from hugging face

3

Is the fine-tuning of InternVL supported by hugging face SFTTrainer? I got the following error when using the SFTTrainer: ```python model = AutoModel.from_pretrained( "OpenGVLab/InternVL2-8B", device_map="auto", torch_dtype=torch.float16, trust_remote_code=True ) tokenizer =...