Andrej Karpathy aeff095e97 better comments/flow on all the hyperparameter transfer stuff, and change the WD scaling from my empirical 1/d^2 to a bit more principled version based on Tepoch. All of that theory is based on AdamW and could be suboptimal for Muon

2026-02-06 19:22:28 +00:00

31 KiB

Raw Blame History

View Raw