Add support for GPU int2 prefill

Open huing4257 opened this issue 6 months ago • 2 comments

Add gemm kernel for int2 weight. Also fix scaling problems in previous bitlinear kernel.

Jul 30 '25 03:07 huing4257

@microsoft-github-policy-service agree

Jul 30 '25 03:07 huing4257

fix #284 :

Could you help me explain Python?

Of course! Python is a high-level, interpreted programming language known for its simplicity and readability. Here are some key points to help you understand Python: ...

Jul 30 '25 10:07 huing4257