Thanks to visit codestin.com
Credit goes to dstekanov.substack.com

Dmytro Stekanov

Dmytro Stekanov

Home
Notes
Brain
Artificial Intelligence
Archive
About
Most Popular
View all
[BPE] Scaling Up: Parallelization
 • Dmytro Stekanov
Building a Tokenizer From Scratch: A Journey Through Stanford’s CS336
 • Dmytro Stekanov
When your tokenizer meets reality: building BPE v2
 • Dmytro Stekanov
[BPE] Scaling Up: File Processing
 • Dmytro Stekanov
Why BPE tokenizers use UTF-8 instead of UTF-16 or UTF-32
 • Dmytro Stekanov
Dot Product: the simple operation that bends a complex world
 • Dmytro Stekanov
[BPE] Scaling Up: Parallelization
Part 2: Parallelizing Pre-tokenization and Optimizing the Merge Step
 • Dmytro Stekanov
[BPE] Scaling Up: File Processing
Part 3 of the Tokenizer Series
 • Dmytro Stekanov
When your tokenizer meets reality: building BPE v2
Or: Why production tokenizers are nothing like the textbook version
 • Dmytro Stekanov
Building a Tokenizer From Scratch: A Journey Through Stanford’s CS336
Or: How I stopped memorizing and started understanding
 • Dmytro Stekanov
Why BPE tokenizers use UTF-8 instead of UTF-16 or UTF-32
Inside tokenizer training: why UTF-8 gives cleaner signals and faster learning than UTF-16 or UTF-32.
 • Dmytro Stekanov
Conditional probability - how to see what we usually don't see
We often evaluate the world directly.
 • Dmytro Stekanov
Dot Product: the simple operation that bends a complex world
Understanding the Dot Product: Math, Intuition, and AI Applications
 • Dmytro Stekanov
Dmytro Stekanov
Dmytro Stekanov
My personal Substack

Dmytro Stekanov

AboutArchive
© 2026 Dmytro Stekanov · Privacy ∙ Terms ∙ Collection notice
Codestin Search App Start your SubstackGet the app
Substack is the home for great culture