Andrej Karpathy 324e69c45d big, breaking change but large upside: swap previous FineWeb-EDU dataset to NVIDIA ClimbMix dataset. Requires people to download the data shards. The upside is that training GPT-2 capablity model now only takes ~2 hours, down from 2.76 hours, so this is a huge win data-wise

2026-03-04 19:47:12 +00:00

..

base_eval.py

small touchups to the eval script, re-order items etc, cosmetic

2026-02-03 21:03:42 +00:00

base_train.py

big, breaking change but large upside: swap previous FineWeb-EDU dataset to NVIDIA ClimbMix dataset. Requires people to download the data shards. The upside is that training GPT-2 capablity model now only takes ~2 hours, down from 2.76 hours, so this is a huge win data-wise

2026-03-04 19:47:12 +00:00

chat_cli.py

remove leftover mid references (#491)

2026-02-02 08:33:46 -08:00

chat_eval.py

remove leftover mid references (#491)

2026-02-02 08:33:46 -08:00

chat_rl.py

remove leftover mid references (#491)

2026-02-02 08:33:46 -08:00

chat_sft.py

Restore completion-only loss masking in SFT dataloader (#582)

2026-03-02 16:37:47 -08:00

chat_web.py

remove leftover mid references (#491)

2026-02-02 08:33:46 -08:00

tok_eval.py

initial commit

2025-10-13 06:49:24 -07:00

tok_train.py

quick fix to not OOM main speedrun script

2026-01-26 22:31:42 +00:00