cutlass icon indicating copy to clipboard operation
cutlass copied to clipboard

Supports for s4 and s8 GEMM on Python?

Open mlpen opened this issue 1 year ago • 3 comments

Hi,

There are supports for using cutlass on Python https://github.com/NVIDIA/cutlass/blob/main/python/README.md, so I am wondering if there is a plan to support s4 and s8 GEMM on Python. If not, is there any resource that I can use if I want to implement them by myself?

Thanks!

### Tasks

mlpen avatar Apr 08 '24 05:04 mlpen

The CUTLASS Python interface does support s8 GEMMs. Unit tests that show examples of using these are here and here.

The CUTLASS Python interface does not currently support s4. You can see this issue for some details related to this: https://github.com/NVIDIA/cutlass/issues/756

jackkosaian avatar Apr 08 '24 11:04 jackkosaian

Thank you so much for the prompt response! This is helpful.

mlpen avatar Apr 08 '24 19:04 mlpen

This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.

github-actions[bot] avatar May 17 '24 16:05 github-actions[bot]