MixtralKit icon indicating copy to clipboard operation
MixtralKit copied to clipboard
verified publisher icon open-compass

why the performance for the GSM8K and MATH lower than the original mixtral blog?

Open runzeer opened this issue 2 years ago • 0 comments

I noticed that the performance for the math reasoning is lower than the official blog. Is it due to the zero-shot setting compared the official 5-shot setting?

runzeer avatar Dec 11 '23 16:12 runzeer