 Andrej Karpathy
|
23985413aa
|
adjust the comment on the regex pattern per recent experimnet see dev/LOG.md
|
2026-01-13 17:50:39 +00:00 |
|
|
Andrej Karpathy
|
21608ec51e
|
allow base_loss to report the loss of any arbitrary huggingface model similar to base_eval. had to change dataloader to be a lot better and just take tokenizer, not load the nanochat one. much better this way anyway
|
2026-01-12 03:10:13 +00:00 |
|
|
Andrej Karpathy
|
962b6bfba3
|
alright add transformers as a dep of the repo because it should be easy to evaluate the CORE score of HF models. Not super happy about it but i tried it and the uv.lock doesn't get bloated as much as i expected
|
2026-01-04 20:37:28 +00:00 |
|
|
Andrej Karpathy
|
cc3636b01c
|
allow the tokenizer visualize_tokenization to also print the exact token id. you can never be paranoid enough
|
2025-10-24 13:27:05 +00:00 |
|
|
karpathy
|
3a5e0bc50b
|
initial commit
|
2025-10-13 06:49:24 -07:00 |
|