Andrej Karpathy aeff095e97 better comments/flow on all the hyperparameter transfer stuff, and change the WD scaling from my empirical 1/d^2 to a bit more principled version based on Tepoch. All of that theory is based on AdamW and could be suboptimal for Muon

2026-02-06 19:22:28 +00:00

..

base_eval.py

small touchups to the eval script, re-order items etc, cosmetic

2026-02-03 21:03:42 +00:00

base_train.py

better comments/flow on all the hyperparameter transfer stuff, and change the WD scaling from my empirical 1/d^2 to a bit more principled version based on Tepoch. All of that theory is based on AdamW and could be suboptimal for Muon

2026-02-06 19:22:28 +00:00

chat_cli.py

remove leftover mid references (#491)

2026-02-02 08:33:46 -08:00

chat_eval.py

remove leftover mid references (#491)

2026-02-02 08:33:46 -08:00

chat_rl.py

remove leftover mid references (#491)

2026-02-02 08:33:46 -08:00

chat_sft.py

fix bug in chat_sft, the attention window must be preserved sigh

2026-02-01 20:58:44 +00:00

chat_web.py

remove leftover mid references (#491)

2026-02-02 08:33:46 -08:00

tok_eval.py

initial commit

2025-10-13 06:49:24 -07:00

tok_train.py

quick fix to not OOM main speedrun script

2026-01-26 22:31:42 +00:00