CoLLiE icon indicating copy to clipboard operation
CoLLiE copied to clipboard

Could Lomo class support `param_groups`?

Open JinchaoLove opened this issue 2 years ago • 0 comments

As a subclass of torch.optim.Optimizer, could collie.optim.Lomo support param_groups, by calling super().__init__(params, defaults). So that we can fit for more schedulers and use per-parameter method to filter out some modules that can not useweight_decay.

JinchaoLove avatar Sep 12 '23 10:09 JinchaoLove