Medusa icon indicating copy to clipboard operation
Medusa copied to clipboard
verified publisher icon FasterDecoding

Does Medusa support beam search decoding strategy?

Open xs229 opened this issue 1 year ago • 0 comments

Thanks for the wonderful work. From what it looks like, you are using greedy decoding strategy. I would like to know if Medusa tree-attention supports beam search decoding strategy.

xs229 avatar Jun 14 '24 05:06 xs229