tyu008

Could not reproduce the answer recall for NQ dataset

4

Hi, I load nq/full-00000-of-00001.parquet and compute the answer recall based on answers, context = item["answer"], item["context"] is_retrieval = has_correct_answer(context, answers) I could only get 0.8532 answer recall, which is below...