Jude Oh

How to get citation data?

1

Hello, I would like to test on the citation dataset, but it seems not open to public. In the SNAP website, I found below: The Web of Science citation data...

lm_eval result is not reproducible in multiple runs

1

Hi. I am evaluating AWQ on `meta-llama/Llama-3.2-1B-Instruct` model. In original model (BF16), multiple runs guarantee identical results but after AWQ it seems not guaranteed in part of tasks (truthfulqa, winogrande)....