copasseron comments

Repositories
Issues
Comments

Results 3 comments of


                                            copasseron

Question: Will TensorRT 9 be available in the 23.11 NGC container ?

Any update on this ? can we hope for the 24.02 NGC container ? it's mainly related to this issue for my side: https://github.com/NVIDIA/TensorRT/issues/3124

feat: OpenAI Compatible Frontend

Hi @rmccorm4 , thanks a lot on this PR. Huge work very appreciated here. Do you know if you're planning to add a support for Function Calling / Tools support...

[Bug]: KeyError: 'layers.60.mlp.gate_up_proj.weight' mistral large bitsandbytes

@mgoin thank you for having looked at it. What would be the way to solve this issue ? Do you think about a workaround or another way to load mistral...