unilm icon indicating copy to clipboard operation
unilm copied to clipboard

LayoutReader: Evaluation metric ARD

Open WeihongM opened this issue 4 years ago • 1 comments

Hello, thanks for the impressive work. I want to ask the calculation of the evaluation metric "ARD" in the reported paper. Do you calculate the ARD by dividing the number of test set? or just summing up all the ARD result on testset (without dividing the number of test set). @HYPJUDY @zlwang-cs Thanks.

WeihongM avatar Dec 21 '21 03:12 WeihongM

Yes, we first sum up the "RD" for each page in the testing set and then divide it by the number of pages in the testing set so the final result is "ARD" aka "Average RD"

zlwang-cs avatar Apr 26 '22 21:04 zlwang-cs

@zlwang-cs @WeihongM Could you please let me know in which part of the code the 'ARD' is calculated? thanks

hpc-liuyang avatar Nov 27 '23 13:11 hpc-liuyang