simplerepresentations icon indicating copy to clipboard operation
simplerepresentations copied to clipboard

xlm-roberta?

Open KnutJaegersberg opened this issue 6 years ago • 3 comments

Could you add xlm roberta? see https://huggingface.co/transformers/pretrained_models.html

KnutJaegersberg avatar Jan 09 '20 14:01 KnutJaegersberg

Hello @KnutJaegersberg, I was trying to add CamemBERT and XLM-RoBERTa, but I faced the following issue:

TypeError: can't pickle SwigPyObject objects

So, I'm looking for a solution. Please, let me know if you have a solution for such issue.

AliOsm avatar Jan 10 '20 17:01 AliOsm

a related error was recognized, and supposed to be solved with transformers 2.3 ...

https://github.com/flairNLP/flair/issues/840

https://github.com/huggingface/transformers/pull/2189

I guess the issue will be resolved in the transformers lib given a bit more time.

KnutJaegersberg avatar Jan 13 '20 10:01 KnutJaegersberg

Thank @KnutJaegersberg for your support, I will look into this.

AliOsm avatar Jan 13 '20 10:01 AliOsm