Which datasets used to generate the models ?

[ycattan]

Hi ! Thank you very much for this great repo and work.
I would be interested in working with your bert-tiny model. For this work, it would be of importance to know what data exactly this model was obtained from. I could not find a concrete pointer.
Would you be able to guide me to a specification of this information? Thank you a lot in advance and kind regards!

[ritikranjan12]

@ycattan Hello,this model is not trained on a single datasets.It is trained on collections of different huge datasets .

To know more you must read this blog on their official site..h https://huggingface.co/blog/bert-101