weiqisunnvidia

Results 1 comments of weiqisunnvidia

Error while building Finetuned Mistral model using trt-llm

Hi, could you try the following command to build the engine? `trtllm-build --checkpoint_dir trt_model_bf16 --output_dir trt_engine_bf16 --gemm_plugin bfloat16 --max_input_len 32256 --gpt_attention_plugin bfloat16`