Glossary · Core Concepts

Softmax

A mathematical function that converts a set of raw model outputs into a probability distribution, used at the final layer of a language model to determine next-token probabilities.