privacy icon indicating copy to clipboard operation
privacy copied to clipboard

The accuracy of DPSGD_Kears only have 10%

Open Mrxulovemingming opened this issue 4 years ago • 7 comments

Use DPSGD in the previous mnist_dpsgd_tutorial.py There can be 90% accuracy in the file, but in mnist_dpsgd_tutorial_keras.py The medium accuracy is about 10%. I did not modify the relevant code, but the result of DPSGD_keras does not seem to be correct image

Mrxulovemingming avatar Mar 25 '21 13:03 Mrxulovemingming

Thanks for the report-- I'll take a look.

schien1729 avatar Apr 12 '21 05:04 schien1729

Hi @Mrxulovemingming ,

Can you share your command line? I just tried this command line:

python3 code/tutorials/mnist_dpsgd_tutorial_keras.py

with no extra arguments and got this output:

Screen Shot 2021-04-12 at 10 32 04 PM

schien1729 avatar Apr 13 '21 05:04 schien1729

Hello Schien, I use the same code as you. I run the code in the Spyder environment, and I did not modify anything in the code. As you can see, my running accuracy has been around 10%. I don't know if this is due to a problem with the version of the imported package.

Mrxulovemingming avatar Apr 22 '21 02:04 Mrxulovemingming

image This is the result I just ran

Mrxulovemingming avatar Apr 22 '21 02:04 Mrxulovemingming

I used the CPU to run the code and got the same result as you. But the accuracy of running the GPU is still only 10%. What may be the reason for this. The CPU runs very slowly Uploading image.png…

Mrxulovemingming avatar Apr 22 '21 05:04 Mrxulovemingming

Thanks for the extra information. I'm looking into it. By the way, is there an image missing in your last message?

schien1729 avatar Apr 22 '21 06:04 schien1729

I have solved this problem,when i using the tensorflow 2.2.0.The accuracy stay at 10%.But when I use the tensorflow 2.4.0 ,cuda 11.1,the result is the same as you

Mrxulovemingming avatar Apr 24 '21 14:04 Mrxulovemingming