Simha55

AttributeError: 'DPMultiheadAttention' object has no attribute 'batch_first'

3

## 🐛 Bug Hi there is a bug with model.eval() and DPMultiheadAttention. I have attached the colab link: https://colab.research.google.com/drive/1fwK-5o5EUJEIWQMRg0m__cIyCy5_J-ij?usp=sharing Please check the def testing(model, bs, criterion, data): function in the...

Difference in Accuracy between setting epsilon to 10^6 and model wiithout opacus to train.

1

## 🐛 Bug I tried 2 variations and trained my models one is setting epsilon to 10^6 and other is training the model simply without opacus. I find that results...