DP-FTRL

Open ffuuugor opened this issue 3 years ago • 1 comments

DP-FTRL is a new online learning based DP algorithm proposed by team at Google in https://arxiv.org/pdf/2103.00039.pdf.

Authors claim it's superior compared to DP-SGD and also doesn't rely on privacy amplification, which is an important point in FL environment.

Based on some very crude understanding of DP-FTRL it looks like it can be seamlessly implemented using opacus primitives with minimial changes - we should consider it

Mar 25 '22 16:03 ffuuugor

I thought the decision to not have DP-FTRL in Opacus but rather have it in Opacus lab?

Mar 25 '22 17:03 JohnlNguyen