InsightFace_Pytorch icon indicating copy to clipboard operation
InsightFace_Pytorch copied to clipboard

How to get 10-fold split lists for CALFW and CPLFW?

Open wandering007 opened this issue 6 years ago • 6 comments

Hi, thanks for providing this awesome project.

After I downloaded CALFW and CPLFW datasets from the official websites, I found that there are no off-the-shelf 10-fold cross-validation lists among the files.

I want to ask that how the project process and evaluate CALFW and CPLFW datasets. It would be appreciated if you could provide me the 10-fold split list files. Thanks a lot!

wandering007 avatar Oct 19 '19 15:10 wandering007

For CPLFW,“Based on it, our CPLFW dataset has been divided into 10 separate folds using the same identities contained in the LFW 10 folds.”

hjy1312 avatar Nov 05 '19 12:11 hjy1312

@hjy1312 Thanks! I'll try it.

wandering007 avatar Nov 06 '19 03:11 wandering007

@hjy1312 Hi, I have split the 10 folds correctly after matching identities with LFW dataset. But the results on CALFW and CPLFW are quite low (LFW: 99.7%, CALFW: ~70%, CPLFW: ~65%). Have you been ever faced with this issue before? Thanks!

wandering007 avatar Nov 06 '19 06:11 wandering007

@wandering007 Compared with the LFW pair list file, I suppose you can directly split the pair list into 10 parts in sequence. But I'm not sure whether the data should be divided in this way.

hjy1312 avatar Nov 06 '19 07:11 hjy1312

@wandering007 Compared with the LFW pair list file, I suppose you can directly split the pair list into 10 parts in sequence. But I'm not sure whether the data should be divided in this way.

Yes, quite like this. I am quite sure that the 10-fold split problem is solved. But I still get low results, which makes me very confused.

wandering007 avatar Nov 06 '19 07:11 wandering007

@wandering007 Maybe there're other factors influencing the experimental results. I test my model with the directly split 10 folds data, the accuracy is about 82.6%. And when I test the model with randomly selected 10 folds according to , the accuracy is 80.667%.

hjy1312 avatar Nov 06 '19 15:11 hjy1312