jivanph

First, I would like to thank you so much for your contribution to the literature. I wanted to ask how is token verification implemented in your code, since it remains...

In the benchmark studies, how are the draft tokens generated?

9

I read with great interest your paper 'Lookahead: An Inference Acceleration Framework for Large Language Model with Lossless Generation Accuracy'. In essence, the paper proposes a tree data structure to...

Counting how many forward passes/steps were done when using PAIN

4

I wanted to ask if there's a way to count how many forward passes/steps are done when using PAIN, to contrast it with standard decoding.