Alessio Netti comments

Repositories
Issues
Comments

Results 2 comments of


                                            Alessio Netti

Top-P sampling occasionally produces invalid tokens

Hi - the bug has been fixed a few versions back, so we can close this.

Missing logits in Executor API when using `return_generation_logits`

Hi again - this specific issue was addressed, though there still seem to be minor issues as of version `0.15.0.dev2024110500`, specifically regarding generation logits and early stopping due to `end_id`....