TensorRT-LLM
TensorRT-LLM copied to clipboard
Is Mistral-7B v0.2 supported?
System Info
A100 GPUs (40GB)
Who can help?
@byshiue
Information
- [ ] The official example scripts
- [ ] My own modified scripts
Tasks
- [ ] An officially supported task in the
examplesfolder (such as GLUE/SQuAD, ...) - [ ] My own task or dataset (give details below)
Reproduction
n/a
Expected behavior
n/a
actual behavior
n/a
additional notes
n/a