localGPT icon indicating copy to clipboard operation
localGPT copied to clipboard

Model returns blank answers

Open naorsabag opened this issue 2 years ago • 0 comments

Also got the following related warning:

Input length of input_ids is 2326, but max_lengthis set to 2048. This can lead to unexpected behavior. You should consider increasingmax_new_tokens.

How can I increase max_new_tokens or alternatively reset the current session?

naorsabag avatar Jun 05 '23 16:06 naorsabag