Skip to main content
RugvAI Labs
Show chat and tutor
NLP & Transformers
Rugv
AI
Labs
Learn
Practice
Reference
Blog
Search...
⌘K
తె
Sign In
RugvAI Labs
All playgrounds →
BPE Tokenizer
Share
Tokenize
Vocabulary size:
7
Current tokens:
22
Final tokens:
14
t
h
e
SP
c
a
t
SP
s
a
t
SP
o
n
SP
t
h
e
SP
m
a
t
Characters
Step 0/4
0.5x
1x
2x
4x