Question about "Partial Match"

Open Jh-SYSU opened this issue 5 years ago • 1 comments

Great Work!

I'm trying to follow your paper, but I'm having trouble with the Rationale accuracy on the toxicity dataset. Could you provide more details on how to calculate the Rationale accuracy, especially the "Partial Match"

Thanks a lot!

Jan 04 '21 09:01 Jh-SYSU

Hi,

The partial match AUC is defined in this paper (called Attribution AUC): https://www.pnas.org/content/116/24/11624

Jan 07 '21 16:01 wengong-jin