CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard
verified publisher icon OpenNMT

Top-p (nucleus) sampling support.

Open BrightXiaoHan opened this issue 4 years ago • 0 comments

I have read the api doc, finding that the decode options do not support Top-p (nucleus) sampling which described in this blog https://huggingface.co/blog/how-to-generate#top-p-nucleus-sampling

Is it possible to support this feature in the future release?

BrightXiaoHan avatar Dec 15 '21 03:12 BrightXiaoHan