RepNet-Pytorch icon indicating copy to clipboard operation
RepNet-Pytorch copied to clipboard

model overfiting

Open qrsforever opened this issue 4 years ago • 3 comments

Hello, when i train the model, after 35 epochs, the valid loss curve is as follows:

Screenshot from 2021-06-03 10-10-50

Can you give me some tips ?

qrsforever avatar Jun 03 '21 02:06 qrsforever

What datasets and loss functions did you use? There is also UCFRep dataset.

confifu avatar Jun 03 '21 04:06 confifu

@confifu

Used Countix Dataset:

train dataset: trainvids valid dataset: valvids test dataset: testvids

Loss:

SmoothL1Loss for period length

BCEWithLogitsLoss for periodicity

qrsforever avatar Jun 03 '21 07:06 qrsforever

Given limited data, the model is bound to overfit. Use other datasets, the SyntheticDataset class implements the technique mentioned in the paper. There are some videos from kinetics dataset in the synthvid directory. I wrote the class so that it can take large single files as well, so you can put in any random long video files into it as well. Also compare the metrics (OBO and MAE) that you get with those of the paper. They are better indicator of model performance than absolute loss values.

confifu avatar Jun 03 '21 07:06 confifu