← back to paper

Review history

arxiv: 2506.15138 · 2 revisions

Thunder-Tok: Minimizing Tokens per Word in Tokenizing Korean Texts for Generative Language Models

1. 2026-08-15 CONDITIONAL MODERATE v1.4.0-alltime-deepseek-medium novelty 6.0
   136369 ms 16090 in 14322 out 2026-08-15T19:42:32.292860+00:00
2. 2026-08-07 CONDITIONAL MODERATE v1.4.0-alltime-deepseek-medium novelty 6.0
   82699 ms 16090 in 10750 out 2026-08-07T00:01:14.973751+00:00