DecompRC icon indicating copy to clipboard operation
DecompRC copied to clipboard

Type classifier model has wrong shape (2-way instead of 4-way classification)?

Open talkhaldi opened this issue 3 years ago • 0 comments

Hi,

Thank you for your work and repository.

I'm trying to use the type classifier explained in your paper in Sec. 3.4 (Pipeline Approach), where you first predict the reasoning type of the question. You use a BERT model with a 4-way classifier on top. However, examining the type classifier model file released in "DecompRC-all-models-and-data.zip", the classifier is 2-way (similar to the scorer model). Am I missing something? Is the "type-classifier" folder released different than the reasoning type classifier explained in the paper?

Since only the type predictions of dev are released, can you please either release the train questions type predictions or the classifier model?

Thanks in advance!

talkhaldi avatar May 16 '22 03:05 talkhaldi