lightseq icon indicating copy to clipboard operation
lightseq copied to clipboard
verified publisher icon bytedance

GPT2 推理怎么使用beam_search，并同时输出多个结果呢？

Open wotulong opened this issue 3 years ago • 1 comments

GPT2 推理怎么使用beam_search，并同时输出多个结果呢？有参考代码么？谢谢！

wotulong avatar Aug 16 '22 09:08 wotulong

Lightseq doesn't support gpt2 with beam search currently, you can try topk sampling and topp sampling.

Taka152 avatar Aug 30 '22 07:08 Taka152