lightseq support for triton backend inference?

[RyanHuangNLP]

Does lightseq support triton for the back end for inference？

[Taka152]

Yes,you can check the readme in inference.

---

发件人: RyanHuangNLP @.> 发送时间: Thursday, August 12, 2021 7:00:29 PM 收件人: bytedance/lightseq @.> 抄送: Subscribed @.***> 主题: [bytedance/lightseq] lightseq support for triton backend inference? (#156)

Does lightseq support triton for the back end for inference？

― You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/bytedance/lightseq/issues/156, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AELIZAJUCYZYB2NN4H3TGLTT4OSU3ANCNFSM5CA4LNTA.

[hrdxwandg]

the readme is this: https://github.com/bytedance/lightseq/tree/master/lightseq/inference? Is there any more clear example? @Taka152

[Taka152]

@hrdxwandg No, there is no more doc or example for triton currently.