xs229

Thanks for the wonderful work. From what it looks like, you are using greedy decoding strategy. I would like to know if Medusa tree-attention supports beam search decoding strategy.