Farhan Ahmed
Farhan Ahmed
@subdavis seems to be completed, can you verify?
@beat-buesser once you've taken a look, please let me know if you think there should really be a different implementation for each framework. I don't believe there is much benefit...
> Hi @f4str That's a good question. Can we think of an application where accurate gradient back-propagation would be useful? E.g for an adaptive poisoning attack on DP-InstaHide? Hi @beat-buesser...
> Hi @f4str The augmentations are random, but an adaptive still needs accurate gradients corresponding to the respective randomly sampled augmentation. Hi @beat-buesser that is true. In that case, it...
@beat-buesser PR #2321 should now be fixed. It's also been rebased to the `dev_1.18.0` branch. Feel free to close this PR in favor of the other one.
Hello, has there been any updates on this? It would be very useful to have this task available in the library since it's been increasingly used in literature. It looks...
> > Hello, has there been any updates on this? It would be very useful to have this task available in the library since it's been increasingly used in literature....
I've ran the benchmark for some of the popular open source models which have results for CommonsenseQA in their paper. Here's a table with the results comparing the reported value...