WDHT icon indicating copy to clipboard operation
WDHT copied to clipboard

mAP on 12bit is only 0.3269

Open chenshen03 opened this issue 6 years ago • 11 comments

I used all the pre-training models and data you provided to test. But on 12 bits, the mAP is only 0.3269. Why is the result so different from that of the paper?

image

chenshen03 avatar Apr 22 '19 06:04 chenshen03

We will look into this and get back to you. Will be busy this whole week. Please expect a delayed response.

Vijetha1 avatar Apr 22 '19 17:04 Vijetha1

@Vijetha1 Thank you for your help. I've been waiting for your reply. Have you found the reason for the problem?

chenshen03 avatar May 06 '19 09:05 chenshen03

Hi Chen, trying to replicate this issue. Will update you asap.

Vijetha1 avatar May 06 '19 19:05 Vijetha1

Hi Chen, I was not able to replicate the issue nor the set-up due to the lack of support for Theano. Instead, I recreated the code with Tensorflow backend and it is working as expected. Please verify now.

Vijetha1 avatar May 29 '19 02:05 Vijetha1

Thank you very much for your patient answer. I'll try again.

chenshen03 avatar May 29 '19 02:05 chenshen03

Hi, were you able to verify this?

Vijetha1 avatar Aug 30 '19 20:08 Vijetha1

HI ,I cannot find the dataset and pretrain weight ,can you help me?

ximi2018 avatar Sep 21 '19 07:09 ximi2018

@ximi2018 Can you download the dataset and weight? I cannot download them. Could you tell me how to deal with it?

mengliu1991 avatar Nov 28 '19 08:11 mengliu1991

@mengliu1991 sorry,I cannot get them

ximi2018 avatar Nov 28 '19 08:11 ximi2018

@mengliu1991 @ximi2018 Maybe you need a VPN. The link provided by the author is still available for download.

chenshen03 avatar Nov 28 '19 15:11 chenshen03

@chenshen03 Hi, Have you test the L3 loss+L4 loss case, i.e., using the similarity matrix to train the model? I change the model into the binary tag-vector model, but I cannot obtain the result reported in the paper.

mengliu1991 avatar Dec 17 '19 00:12 mengliu1991