optimize training

[AleKitsune98]

How to specify parameters like warmup_ratio, dropout in finetuning?

[mkmohangb]

Check this file for the details.

[AleKitsune98]

thank you, I have tried the script but when I come to the val step it says "Object of type SimpleNameSpace is not JSONSerializable"

[urchade]

Hi @AleKitsune98, can you send me a screenshot of the error?

[mkmohangb]

I was able to reproduce the issue and created a pull request with the fix.

[AleKitsune98]

Thank you very much, now I am getting division by zero during evaluation. I'm using training with huggingface model in config.yaml

[urchade]

Have you downloaded the correct dataset ? @AleKitsune98 Here is the link: # "NER_datasets": val data from the paper can be obtained from "https://drive.google.com/file/d/1T-5IbocGka35I7X3CE6yKe5N_Xg2lVKT/view"

[AleKitsune98]

I created a custom dataset following the format of sample_data.json

[urchade]

The training evaluation is intended for benchmark comparison on the data I linked before, but you can modify the code by looking at this link if you have JSON evaluation data.

[AleKitsune98]

Thank you very much. I will take a look at it. I appreciate your work!