fmobrj
fmobrj
@ellurunaresh Hi. Have you managed to implement Cold Fusion or find any resource? I will begin to experiment it with BERT and ULMFIT.
> > I have converted to TFLite file successfully in TF 2.3, but you cannot convert it under TF 2.3. > > it is because, as of now, only TF...
@StephennFernandes have you manage to train successfuly? I am training a portugues version. I am getting 67,5% validation ccuracy and 1,55 validation loss, after 70k steps (64 for batch size)...
> @fmobrj i just ran the rtd.sh pretraining script to ensure everything i working fine. didn't really emphasis on the training metrics. > > However gently pinging @BigBird01 as this...
> @fmobrj hey curious to know what hparams did you use how big was your training data, and incase i could get to check your training metrics to better understand...
Sure. Send me a DM.
My training metrics up to now: [04/28/2023](url) 10:08:52|INFO|RTD|00| device=cuda, n_gpu=1, distributed training=False, world_size=1 04/28/2023 10:09:01|INFO|RTD|00| Training batch size = 64 04/28/2023 10:09:01|INFO|RTD|00| Num steps = 1000000 04/28/2023 10:19:56|INFO|RTD|00| [D][0.0%][-1813.71h] Steps=100,...
The discriminator seems to be learning nothing. After 79k steps at each 1k dump, the discriminator result is: Best metric: 0@1000, despite the generator learning and diminishing loss and increasing...
Hi, @BigBird01! Is it expected that during training, the metric for the Discriminator stays at "Best metric: 0@1000" after many steps (currently it is at 5811200 examples and 90k steps)?...
Hi, @pvcastro ! I tried, but it is not converging when applying the model to a classification task in portuguese that works even with the english pretrained model in Huggingface....