FasterTransformer icon indicating copy to clipboard operation
FasterTransformer copied to clipboard
verified publisher icon NVIDIA

Is llama2 70b supported? Do you know minimal configuration?

Open ChristineSeven opened this issue 2 years ago • 1 comments

ChristineSeven avatar Oct 23 '23 04:10 ChristineSeven

FasterTransformer development has transitioned to TensorRT-LLM.

LLaMa 2 70B is supported in TensorRT-LLM. Please take a try.

byshiue avatar Oct 24 '23 00:10 byshiue