MIME icon indicating copy to clipboard operation
MIME copied to clipboard

Dataset Sample Number Mismatched

Open jeremychang9 opened this issue 3 years ago • 0 comments

Hi, I was trying to evaluate your model with the output.txt. However, I found that the number of the dataset sample was different. There are supposed to have 5259 samples in the testing set, but yours only get 5255 samples.

For instance, the last dialogue (the last 2 turns of sample) should be:

I have a big test on Monday_comma_ I am so nervous. What is the test on? It's for my Chemistry class. I haven't slept much because I'm worried so I keep studying. Chemistry is quite difficult_comma_have you studied hard?

"sys_dialog_texts.test.npy" also get 5255 samples. Maybe you should check it out, leave a message if you get any news. Thank you.

jeremychang9 avatar Aug 05 '22 13:08 jeremychang9