logits

The raw, unnormalised scores a model assigns to every token in its vocabulary as candidates for the next position.

In more detail

Softmax turns logits into probabilities that sum to one, after temperature has divided them. Some APIs expose the resulting log probabilities of the chosen tokens, which helps measure confidence and debug classifications.

Related terms

Taught in

References

Certification courses