TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard
verified publisher icon NVIDIA

Question regarding RowLinear and ColumnLinear

Open Ashwin-Ramesh2607 opened this issue 1 year ago • 0 comments

Hi, I would like to know when to use RowLinear and ColumnLinear. I see it used in conjuction in mlp.py and attention.py and I'm finding it difficult to know what's the efficient or correct way to identify the correct one to choose when defining custom Linear layers.

Ashwin-Ramesh2607 avatar May 21 '24 18:05 Ashwin-Ramesh2607