simplification icon indicating copy to clipboard operation
simplification copied to clipboard

SARI does not work for short sequence?

Open JiyangZhang opened this issue 3 years ago • 0 comments

Hi,

Thanks for the great work! I have a problem with SARI score. Looks like it does not support sequence with one word for example? See the example below:

test_src = "global"
test_pred = "scenarioPattern"
test_ref = "scenarioPattern"
print(SARIsent(test_src, test_pred, [test_ref]))

the score is 0.17 rather than 1.

Is a bug or as expected?

Thank you.

JiyangZhang avatar Mar 10 '22 21:03 JiyangZhang