Antoine Nzeyimana

icon company University of Massachusetts Amherst icon location PhD Candidate in ECE, AI & Embedded Systems, UMass Amherst | Independent R&D towards Kinyarwanda Language Technology, KINLP R&D

Results 2 comments of Antoine Nzeyimana

support for amp?

I have forked and implemented the idea here: https://github.com/anzeyimana/Pytorch-PCGrad-GradVac-AMP-GradAccum

reduction is always 'mean'

See the forked version here with the issue corrected: https://github.com/anzeyimana/Pytorch-PCGrad-GradVac-AMP-GradAccum