ZagButNoZig

This is when pinging my local router. I get some pretty fishy times. And again only the first few packets are really slow and the thing gradually speeds up. ```...

Ok so... I don't know what changed because I don't remember changing anything but now for some random reason the stability issue is fixed.  But for same random reason...

Thanks! I will have to test a bit more, it seems to be stable at max speed currently but I will have to do further testing. I find it pretty...

Hey @Ralith I would be interested in this feature too. What additional data would we need to serialize to get deterministic serialization working? I was looking trough the code and...

@jrose-signal any updates on this? It still seems to be on main one year later. Is this a security/privacy concern?

I can make a PR, but only in a few days if that's ok

@vroulet I also noticed the implementation completely ignores [this](https://github.com/KellerJordan/Muon/blob/12dc5336852ec10fbe1a1119ad09c92d2d81505e/muon.py#L45) warning. Should we update the docs accordingly?

> I can also change it for the existing approach (ema), but that would result in a change in what batch norm does (and while it likely results in better...