Yuxuan Hu issues

Repositories
Issues
Comments

Results 3 issues of


                                            Yuxuan Hu

High PPL when groupsize != -1 for OPT model after replace linear layer with quantlinear.

I tried to test GPTQ's PPL metrics on the opt model via opt.py. The PPL metrics of the opt model are normal with the use of fake quantization. However, when...

[QST] Can we use Ampere architecture Sparse Tensor Operations through CuTe API?

In CuTe, I can find files like "include/cute/arch/mma_sm90_gmma_sparse.hpp", but can't find similar files for sm80?

question

? - Needs Triage

inactive-30d

[QST] How to implement a fused mixed precision matrix multiplication such as w4a4 + w16a16?

Dear Team, I wish to implement a fused mixed precision matrix multiplication such as w4a4 + w16a16 where the w16a16 part is small. An example of this kernel used is...

question

? - Needs Triage