ByteTransformer icon indicating copy to clipboard operation
ByteTransformer copied to clipboard
verified publisher icon bytedance

What is the performance compared to Lightseq?

Open woskii opened this issue 2 years ago • 1 comments

Thx for the marvelous work! Lightseq is also a transformer inference speedup library. I wonder if there is any performance comparison between ByteTransformer and Lightseq?

woskii avatar Feb 22 '23 02:02 woskii

AFAIK there's no direct comparison against lightseq. You're welcome to test both :) Thank you.

yzhaiustc avatar Feb 22 '23 03:02 yzhaiustc