basaran icon indicating copy to clipboard operation
basaran copied to clipboard
verified publisher icon hyperonym

Any chance to support text-generation-inference as backend?

Open hewr2010 opened this issue 2 years ago • 1 comments

https://github.com/huggingface/text-generation-inference

Main features of TGI are quite awesome. It woud be nice to make it additional inference implementation.

hewr2010 avatar Apr 18 '23 02:04 hewr2010

Thanks for introducing TGU, we'll definitely check it out!

fardeon avatar Apr 18 '23 16:04 fardeon