prompt injection

An attack in which text a model reads overrides or redirects the instructions it was given, because instructions and data share one channel.

A successful injection makes the model act for the attacker with every tool and data source it has.

In more detail

It is first in the OWASP Top 10 for LLM Applications, and no prompt reliably prevents it. Mark untrusted text and keep it away from powerful tools to make attacks less likely, then enforce the decisive control outside the model: check every tool call against where data would go.

Related terms

Taught in

References

Certification courses