Raghuveer Thirukovalluru

Finetuning commands for other glue tasks

1

HI, Can you share what finetuning commands you used for other glue tasks? Did you use the same warmup, hyperparameters etc as for the example MRPC command you shared?

Please share a working link for mention proposal module

While I try to load the pretrained model, I get the following error. E0903 21:29:51.073421 46912496399232 error_handling.py:75] Error recorded from prediction_loop: Unable to open table file ./trained_models/corefqa_trained/bert_finetune_ model_7_1800.bin: Data loss:...

Can you give more details on github archive and twitter api datasets? Did you use all years or only specific years?

Unable to reproduce Qampari Closedbook results.

1

I ran your config "qampari_turbo_shot2_closedbook.yaml". I am unable to reproduce the correctness numbers for chatgpt. Numbers I get are {'length': 14.978, 'str_em': 0, 'str_hit': 0, 'num_preds': 5.331, 'qampari_prec': 22.26018716946968, 'qampari_rec':...