Glossary · Core Concepts

Top-K Sampling

A sampling method that restricts the next-token choice to the K most probable candidates, discarding the long tail of unlikely tokens before sampling.