MetaBlues comments

Repositories
Issues
Comments

Results 1 comments of


                                            MetaBlues

[QST] how to use groupwise scaling along M for FP8 gemm to impelement per-token-per-128-channel and blockwise?

> PR opened: [#2095](https://github.com/NVIDIA/cutlass/pull/2095) Hello, @LucasWilkinson. Thx for your [PR](https://github.com/NVIDIA/cutlass/pull/2095), really helps me a lot. I have one little question about scale layouts - why `scaleA` has a stride like...