KFAC-Pytorch icon indicating copy to clipboard operation
KFAC-Pytorch copied to clipboard

verified publisher icon alecwangcq
→

Metadata

Pytorch implementation of KFAC and E-KFAC (Natural Gradient).

Results 2 KFAC-Pytorch issues
Sort by recently updated
recently updated
newest added

Environment details

Hi, I am not able to run the code with the specified pytorch version (0.4.0). Could you please post more details on the exact cuda version, torchvision version, or for...

eldarkurtic avatar eldarkurtic

KL Clipping may be error

https://github.com/alecwangcq/KFAC-Pytorch/blob/25e6dbe14752348d4f6030697b4b7f553ead2e92/optimizers/kfac.py#L137 The KL clipping should be $vFv^T$, here it seems to calculate $vF^{-1}v^T$.

zhengzangw avatar zhengzangw

← Metadata

120
Stars
33
Forks
Watchers

Owner

verified publisher icon alecwangcq

Metadata

Pytorch implementation of KFAC and E-KFAC (Natural Gradient).

Back