Glossary · Core Concepts

Byte-Pair Encoding (BPE)

A common tokenization algorithm that builds a vocabulary by iteratively merging the most frequent adjacent character or subword pairs, balancing vocabulary size against sequence length.