Medusa icon indicating copy to clipboard operation
Medusa copied to clipboard
verified publisher icon FasterDecoding

why什么使用连续提前开辟好的KVcache? 这样本身就引入一个比huggingface实现快的因素？

Open wenhaoli-xmu opened this issue 7 months ago • 0 comments

谢谢

wenhaoli-xmu avatar Jun 19 '25 18:06 wenhaoli-xmu