LLaMA3-Quantization icon indicating copy to clipboard operation
LLaMA3-Quantization copied to clipboard

acc or acc_norm? Which metric is reported

Open BaohaoLiao opened this issue 1 year ago • 0 comments

Hi,

In Table 2, which metric do you report? For example for arc_easy, lm_eval has two metrics acc and acc_norm, which one do you use?

BaohaoLiao avatar Sep 08 '24 11:09 BaohaoLiao