Linly

Linly copied to clipboard

Reame
Issues

推理速度比原版的llama要慢一些

Open zhangsanfeng86 opened this issue 2 years ago • 1 comments

@ydli-ai 感谢分享！请问一下：为什么推理速度比原版的llama要慢一些？

Apr 02 '23 12:04 zhangsanfeng86

可以参考一下这个推理哈～ https://github.com/fengyh3/llama_inference

Apr 12 '23 09:04 fengyh3