Andrej Karpathy ae0bf52529 tune hyperparameters based on overnight sweeps. warmdown_ratio is the biggest free win, increasing 0.2 -> 0.4, and embedding lr can be larger bumping 0.2 -> 0.3

2026-01-05 18:57:46 +00:00

21 KiB

Raw Blame History

View Raw