TransferNet icon indicating copy to clipboard operation
TransferNet copied to clipboard

Neither CWQ nor WebQSP can meet the results reported in your pape

Open nenuzhangkuan opened this issue 3 years ago • 1 comments

Hello, first of all, I would like to express my gratitude for your open source work.

After I downloaded your source code and ran it on my own machine, neither CWQ nor WebQSP could reach the results you reported. CWQ (dev 45.55, test 42.23) and WebQSP (test: 64), I see that in your previous answer, you explained that it might be because of the bert initialization on WebQSP. I don't know what the reason is on CWQ, and I don't know whether you can also share the CWQ checkpoint file

nenuzhangkuan avatar Sep 28 '22 00:09 nenuzhangkuan

Hello, first of all, I would like to express my gratitude for your open source work.

After I downloaded your source code and ran it on my own machine, neither CWQ nor WebQSP could reach the results you reported. CWQ (dev 45.55, test 42.23) and WebQSP (test: 64), I see that in your previous answer, you explained that it might be because of the bert initialization on WebQSP. I don't know what the reason is on CWQ, and I don't know whether you can also share the CWQ checkpoint file

Hello brother, has the cwq reappeared? Mine is also 45-42, I don't know how to solve it, if it is solved, thank you very much

Huiopfsdfsdf avatar Sep 01 '23 13:09 Huiopfsdfsdf