raistefintel
Results
3
comments of
raistefintel
Hi @shu1chen, please check the updated version
Hi @AyuBaiswar! I could replicate your findings. Please note that currently int4 weights decompression only supports plain and transpose layouts. Could you give us more context for these tests?
Closing as stale. Please feel free to reopen it with additional info.