Alessio Netti

Top-P sampling occasionally produces invalid tokens

2

### System Info - Nvidia A40 - CUDA 12.2 - TensorRT 10.0.1.6 - TensorRT-LLM 0.10.0.dev2024050700 ### Who can help? @byshiue ### Information - [X] The official example scripts - [X]...

Missing logits in Executor API when using `return_generation_logits`

2

### System Info - Nvidia A40 - CUDA 12.2 - TensorRT 10.0.1.6 - TensorRT-LLM 0.10.0.dev2024050700 ### Who can help? @byshiue ### Information - [X] The official example scripts - [...