FasterTransformer icon indicating copy to clipboard operation
FasterTransformer copied to clipboard
verified publisher icon NVIDIA

how to pack fastertransformer

Open 77h2l opened this issue 2 years ago • 1 comments

Hi, does FT now support pack the project into a standard python package like whl format, just like huggiface transformers? so that it would be much more convenient to import and call.

77h2l avatar Jun 09 '23 02:06 77h2l

FasterTransformer development has transitioned to TensorRT-LLM.

TensorRT-LLM can be packed into a standard python package, you can refer the installation guide. Please take a try.

byshiue avatar Oct 20 '23 07:10 byshiue