OpenPrompt icon indicating copy to clipboard operation
OpenPrompt copied to clipboard

Why does Random oversampling of imbalanced dataset give worst performance with OpenPrompt?

Open indunil-19 opened this issue 3 years ago • 0 comments

I used a prompt classification model with a mixed template and soft verbalizer while the prompt model was frozen and only the template and verbalizer were tuned using my imbalanced dataset and the model gives 77.51% accuracy. But when I used random oversampled dataset model gives 0.52% accuracy which was really low compared to the previous result.

Can I know whether any reason behind this? (Does oversampled dataset affects prompting?)

image

indunil-19 avatar Jan 15 '23 02:01 indunil-19