Hu Ying

icon company Tsinghua University icon location Senior Undergraduate @ Computer Science and Technology, Tsinghua Univ.

Results 1 issues of Hu Ying

Add support for GPU int2 prefill

2 comment

Add gemm kernel for int2 weight. Also fix scaling problems in previous bitlinear kernel.