hallucination

Output from a model that is fluent and confident but false or unsupported, such as an invented fact, citation, function or package.

A believable wrong answer can be acted on by users or by code without anyone noticing.

In more detail

Language models predict plausible text, not verified facts, so they fill gaps with likely-sounding content. NIST calls it confabulation. Grounding answers in retrieved sources, checking citations in code, letting the model say it does not know and validating names against real registries all reduce the harm.

Related terms

Taught in

References

Certification courses