Ashok Cutkosky
Results
2
comments of
Ashok Cutkosky
Thanks for looking into it! I'm confused how the first issue didn't replicate - my understanding of the issue was that [this os.makedirs call](https://github.com/mosaicml/streaming/blob/09aebeade52137be59e829a16b1d838a13f306be/streaming/base/dataset.py#L499) made it so that `/tmp/streaming` is...
> oh cool. EMA on updates is similar EMA on weights: it has a LR-decay-like effect (see https://arxiv.org/abs/2507.17634). From the perspective of the last update, the effective lr of previous...