milktea

the output for Q4_gguf is strange again!!

1

# Current Behavior the output of Q4 model is very strange. And I see there was ever such a bug, in https://github.com/SJTU-IPADS/PowerInfer/issues/77 and also I see you have given a...

it's strange for the MMLU result

1

Hello, I test the MMLU, using different sparsity from 0 to 90%。But the mmlu score forcus on 50%, which didn't show significant decline as the sparsity becoming large. Since MMLU...