goose icon indicating copy to clipboard operation
goose copied to clipboard

Instead of erroring on context length exceeded after 3 attempts, ask the user what to do

Open salman1993 opened this issue 1 year ago • 0 comments

Currently, we try to attempt truncation 3 times with 90%, 80%, 70% msgs - then fail.

Error: Context length exceeds limits even after multiple attempts to truncate. 

Instead, we can ask the user whether we should attempt futher truncation OR to exit so that user can start a fresh session if they want

salman1993 avatar Feb 05 '25 21:02 salman1993