pytorch_ema

pytorch_ema copied to clipboard

How to use it in pytorch-lightning?

6

Hi, I would like to know how to use pytorch-ema for training in pytorh-lightning?

Devoe-97

is model.eval() necessary within or outside context manager

1

Thank for your this awesome lib.. I had a little question: do we need to use `,model.eval()` inside the `with` context manager? So, which of these are legit please? ```...

abaqusstudent

Is the EMA used for training or just for tracking the EMA

1

Hi, just looking for some clarification on the documentation. I'm new to PyTorch and have tried to figure this out by reading the source code but the mutability of the...

alisonpeard

Thank you for your selfless sharing. In the author's application, EMA has been applied to all parameters that can be trained, but there are some statistics, such as the mean...

zhaohui-yang

question about the use of ExponentialMovingAverage

2

here is my code: from torch_ema import ExponentialMovingAverage model = ... optimizer = ... scheduler = ... ema_model = ExponentialMovingAverage(parameters=pg, decay=0.9999) for epoch in range(args.epochs):# train print('epoch:',epoch,'Current learning rate:', optimizer.param_groups[0]['lr'])...

JunqiLiu-SYSU