EAGLE icon indicating copy to clipboard operation
EAGLE copied to clipboard
verified publisher icon SafeAILab

About reproducing speedup ratio

Open hyomin14 opened this issue 2 years ago • 1 comments

Thanks for sharing your great works!

I tried to reproduce the speedup result on 1 A100 80GB with Llama 2 13b chat. But i failed to reproduce the given speedup result on llama2 13b chat (x3.03).

The results are as below. speed 102.61022168131326 speed0 39.460857776166044 ratio 2.600303882478927

It would be thankful if you can provide your result or any advice.

hyomin14 avatar Apr 26 '24 02:04 hyomin14

You can check #5.

Liyuhui-12 avatar Apr 29 '24 01:04 Liyuhui-12