Stepan Kargaltsev comments

Results 7 comments of


                                            Stepan Kargaltsev

Fix armv8 linux build

Side Note 3: It might have been best to hide wmmx-related stuff under [__ARM_WMMX macro](https://developer.arm.com/documentation/101028/0010/Feature-test-macros) but based on [this libunwind discussion](https://reviews.llvm.org/D21991) clang does not correctly set this macro.

Fix armv8 linux build

@Maratyszcza could you take a look?

enc_dec: prompt_embedding_table not passed to encoder model

@yuekaizhang Well, the plan is: - modify `WhisperEncoder` to have the same signature as regular `EncoderModel` - use `prompt_embedding_table` input to pass actual fbanks features to `WhisperEncoder` - use tritonserver...

[BUG] failing assert in 57_hopper_grouped_gemm example

Hi @ANIKET-SHIVAM, Initially, I was trying to adapt `57_hopper_grouped_gemm` example to be used in https://github.com/tgale96/grouped_gemm (which [is built](https://github.com/tgale96/grouped_gemm/blob/main/setup.py) without NDEBUG flag, but not in debug mode) when I first noticed...

Stepan Kargaltsev

Fix armv8 linux build

Fix armv8 linux build

enc_dec: prompt_embedding_table not passed to encoder model

[BUG] failing assert in 57_hopper_grouped_gemm example

[BUG] failing assert in 57_hopper_grouped_gemm example

How can we integrate the DeepGEMM Fp8 GEMM implementation in TE's block-wise scaling？

How can we integrate the DeepGEMM Fp8 GEMM implementation in TE's block-wise scaling？