TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

Fix default min length

Open akhoroshev opened this issue 1 year ago • 1 comments

When passing 1 to the minimum length I expect at least 1 NOT eof token.

But since 1 is the default value minLengths tensor is nullptr and penalty does't work.

akhoroshev avatar Jul 11 '24 13:07 akhoroshev

@nv-guomingz

akhoroshev avatar Jul 17 '24 12:07 akhoroshev

@nv-guomingz

Thanks for your patience, We'll start integration and verification soon.

nv-guomingz avatar Jul 22 '24 06:07 nv-guomingz

@nv-guomingz ping :)

akhoroshev avatar Aug 20 '24 08:08 akhoroshev

/bot run

karljang avatar Aug 18 '25 22:08 karljang

/bot run

venkywonka avatar Aug 19 '25 00:08 venkywonka

PR_Github #15675 [ run ] triggered by Bot

tensorrt-cicd avatar Aug 19 '25 00:08 tensorrt-cicd

PR_Github #15675 [ run ] completed with state FAILURE /LLM/main/L0_MergeRequest_PR pipeline #11795 completed with status: 'FAILURE'

tensorrt-cicd avatar Aug 19 '25 00:08 tensorrt-cicd