TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

Is Mistral-7B v0.2 supported?

Open vnkc1 opened this issue 1 year ago • 0 comments

System Info

A100 GPUs (40GB)

Who can help?

@byshiue

Information

  • [ ] The official example scripts
  • [ ] My own modified scripts

Tasks

  • [ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • [ ] My own task or dataset (give details below)

Reproduction

n/a

Expected behavior

n/a

actual behavior

n/a

additional notes

n/a

vnkc1 avatar Apr 26 '24 09:04 vnkc1