Bhaskar 02440f670d fix: return inf instead of crashing when evaluate_bpb has zero total_bytes ...

Edge case: all tokens are special tokens or ignored

Return infinity to indicate no meaningful bytes were processed

2025-10-14 17:21:11 +05:30

3.0 KiB

Raw Blame History

View Raw