TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard
verified publisher icon NVIDIA

test: Add tests for Ministral, Codestral, Mistral Small

Open brb-nv opened this issue 10 months ago • 2 comments

This MR adds tests validating FP8, LoRA, Medusa support for following models:

  1. Codestral-22B-v0.1
  2. Ministral-8B-Instruct-2410
  3. Mistral-Small-24B-Base-2501

brb-nv avatar Mar 23 '25 18:03 brb-nv

/bot run

brb-nv avatar Mar 23 '25 18:03 brb-nv

@QiJune @byshiue can you help review this MR from @brb-nv since I know you are now working to reduce the CI test time.

Thanks June

juney-nvidia avatar Mar 23 '25 22:03 juney-nvidia