Shattered?

icon indicating a website link https://blog.shattered.top/

icon company ZWU icon location Ningbo icon location 呃呃，白日梦想家

Results 1 comments of Shattered?

How to build TensorRT-LLM engine on host and deploy to Jetson Orin Nano Super?

Hello, I'm currently trying to run TRT-LLM on a Nano Super 8G as well. I'm attempting to use the officially recommended [Meta-Llama-3-8B-Instruct INT4-GPTQ](https://github.com/NVIDIA/TensorRT-LLM/blob/v0.12.0-jetson/README4Jetson.md#21-build-the-engine-with-int4-gptq), but it's clearly failing due to insufficient...