一路走北

set fp32 for MatMul failure of TensorRT 8.6.1.1 when converting onnx to trt with version 8.6.1.1

3

## Description onnx: https://drive.google.com/file/d/1JgwgwIl71BnJRw2e9FtgV0DGSGzLy0OZ/view?usp=sharing I tried to use fp32 for MatMul in self-attention and cross-attention layer on A100, but it seems not work. - I inserted Cast layer around MatMul...

The KPI of allenai/OLMo-2-0425-1B-SFT cannot be reproduced

1

**Your open source work is very nice.Could you share the hyperparat reproameters thduce OLMo-2-0425-1B instruct in the document? I encountered the problem of KPI during the reproduction process, especially math....