srulikbd comments

Repositories
Issues
Comments

Results 4 comments of


                                            srulikbd

A different discriminator?

@mshlis so can I just replace GPT2 with like "distilbert-base-multilingual-cased"?

A different discriminator?

OK, you are right. I saw experiments that tried to use BERT like LM but got bad results, because of the bidirectionality training. so I think I should find GPT2...

Plot scaling laws of our baseline models

so just to make sure-the loss is taken from the "lm-loss-validation/lm loss validation"? from the last step? or from the global minimum loss?

No module named 'regression'

I had a similar problem- couldn't import: "from hunga_bunga import HungaBungaClassifier" so I just open the hunga bunga lib as a new project in PyCharm, and it fixed it. so...