Repository navigation

Release Tokenizer 3.6.4 - #62

Merged

vthorsteinsson merged 2 commits into

perf/profile-tokenizer-hotspots

Jul 10, 2026

Merged

Release Tokenizer 3.6.4#62
vthorsteinsson merged 2 commits into
masterfrom
perf/profile-tokenizer-hotspots

Commits on Jul 10, 2026
- Optimize raw token generation
  vthorsteinsson
  committed
  294f8fc
- Prepare Tokenizer 3.6.4 release
  vthorsteinsson
  committed
  a7a5dff