reasoning model

A model trained to work through a problem in hidden or summarised reasoning tokens before it writes its answer.

In more detail

Reasoning models do well on multi-step maths, code and planning, at the cost of extra latency and output tokens, which are billed even when hidden. They need less "think step by step" prompting and often ignore or reject sampling settings; you steer them with a reasoning effort or thinking budget instead.

Related terms

Taught in

References

Certification courses