frequency and presence penalties

Sampling settings that lower the scores of tokens already used, to discourage repetition.

In more detail

A presence penalty applies once to any token that has appeared; a frequency penalty grows with each repeat. OpenAI's Chat Completions API accepts both, while many reasoning models reject sampling settings other than their defaults.

Related terms

Taught in

References

Certification courses