tvm icon indicating copy to clipboard operation
tvm copied to clipboard

[Bug] Install on H100 problem about cutlass_fpA_intB_gemm

Open ziyuhuang123 opened this issue 8 months ago • 3 comments

/root/zyhuang/tvm/3rdparty/cutlass_fpA_intB_gemm/cutlass/include/cutlass/matrix.h:7828:7: error: 'struct cutlass::Matrix<Element_, 3, 3>' has no member named 'set_slice3x3'; did you mean 'set_slice_3x3'? [-Wtemplate-body]
 7828 |     m.set_slice3x3({
      |       ^~~~~~~~~~~~
      |       set_slice_3x3
/root/zyhuang/tvm/3rdparty/cutlass_fpA_intB_gemm/cutlass/include/cutlass/matrix.h: In static member function 'static cutlass::Matrix<Element_, 3, 3> cutlass::Matrix<Element_, 3, 3>::reflection(const cutlass::Matrix<Element_, 3, 1>&)':
/root/zyhuang/tvm/3rdparty/cutlass_fpA_intB_gemm/cutlass/include/cutlass/matrix.h:7848:7: error: 'struct cutlass::Matrix<Element_, 3, 3>' has no member named 'set_slice3x3'; did you mean 'set_slice_3x3'? [-Wtemplate-body]
 7848 |     m.set_slice3x3({
      |       ^~~~~~~~~~~~
      |       set_slice_3x3
/root/zyhuang/tvm/3rdparty/cutlass_fpA_intB_gemm/cutlass/include/cutlass/matrix.h: In static member function 'static cutlass::Matrix<Element_, 4, 4> cutlass::Matrix<Element_, 4, 4>::rotation(Element, const cutlass::Matrix<Element_, 3, 1>&)':
/root/zyhuang/tvm/3rdparty/cutlass_fpA_intB_gemm/cutlass/include/cutlass/matrix.h:14008:7: error: 'struct cutlass::Matrix<Element_, 4, 4>' has no member named 'set_slice3x3'; did you mean 'set_slice_3x3'? [-Wtemplate-body]
14008 |     m.set_slice3x3({
      |       ^~~~~~~~~~~~
      |       set_slice_3x3
/root/zyhuang/tvm/3rdparty/cutlass_fpA_intB_gemm/cutlass/include/cutlass/matrix.h: In static member function 'static cutlass::Matrix<Element_, 4, 4> cutlass::Matrix<Element_, 4, 4>::reflection(const cutlass::Matrix<Element_, 3, 1>&)':
/root/zyhuang/tvm/3rdparty/cutlass_fpA_intB_gemm/cutlass/include/cutlass/matrix.h:14028:7: error: 'struct cutlass::Matrix<Element_, 4, 4>' has no member named 'set_slice3x3'; did you mean 'set_slice_3x3'? [-Wtemplate-body]
14028 |     m.set_slice3x3({
      |       ^~~~~~~~~~~~
      |       set_slice_3x3

Running cmake .. && cmake --build . --parallel $(nproc) will trigger bug above.

ziyuhuang123 avatar Jun 21 '25 12:06 ziyuhuang123

There is indeed a real issue here. I'm on Ubuntu with an H100 GPU, and the problem lies in the code itself. I tried switching to versions 0.20 and 0.18, but neither worked. In the end, I had to modify both the CMakeLists.txt and cmake/modules/contrib/cutlass.cmake files by commenting out the parts related to fpA_intB_gemm to make it work.

ziyuhuang123 avatar Jun 22 '25 02:06 ziyuhuang123

I've tried to build cutlass_fpA_intB_gemm this week, and it worked for me on Blackwell.

yongwww avatar Jul 10 '25 23:07 yongwww

@ziyuhuang123 You can try to compile cutlass_fpA_intB_gemm independently. If it is a problem with the machine environment, it is likely to fail.

ConvolutedDog avatar Jul 14 '25 02:07 ConvolutedDog