Pretraining data sharing

[ArijRB]

Hello, Thank you for sharing and the models.

I was wondering if you can share the details about the pre-training data. Is it possible de share the data for pre-training?

Thank you in advance.