3 Commits

Author	SHA1	Message	Date
Andrej Karpathy	962b6bfba3	alright add transformers as a dep of the repo because it should be easy to evaluate the CORE score of HF models. Not super happy about it but i tried it and the uv.lock doesn't get bloated as much as i expected	2026-01-04 20:37:28 +00:00
Andrej Karpathy	cc3636b01c	allow the tokenizer visualize_tokenization to also print the exact token id. you can never be paranoid enough	2025-10-24 13:27:05 +00:00
karpathy	3a5e0bc50b	initial commit	2025-10-13 06:49:24 -07:00