TEAL icon indicating copy to clipboard operation
TEAL copied to clipboard
verified publisher icon FasterDecoding

Reproduction about speedup

Open quaternior opened this issue 9 months ago • 0 comments

Hello, I really enjoy this paper and the code. I want to reproduce the part below(speedup)

Image

So I tested with 1 A100(with following explanation in README), and obtained the result as below.

  Dense TEAL(50%)
Throughput 94.32 135.38
Speedup 1 1.435326548

The speedup between paper and my reproduction is different(x1.78 and x1.43). Since the GPU that is used for reproduction is different from the paper, and is it might be the reason?

Thanks,

quaternior avatar Apr 01 '25 11:04 quaternior