GPTQModel icon indicating copy to clipboard operation
GPTQModel copied to clipboard
Published 2 months ago • verified publisher icon ModelCloud

Torch Linear instead of Triton Linear

Open MekkCyber opened this issue 8 months ago • 0 comments

Hey Team,

In our tests in transformers we were expecting the layer type to be tritonv2 for T4 gpus, but after the latest release it's torch. Any ideas why ? Thanks a lot !

MekkCyber avatar May 20 '25 16:05 MekkCyber