CoLLiE
CoLLiE copied to clipboard
Could Lomo class support `param_groups`?
As a subclass of torch.optim.Optimizer, could collie.optim.Lomo support param_groups, by calling super().__init__(params, defaults).
So that we can fit for more schedulers and use per-parameter method to filter out some modules that can not useweight_decay.