majority label bias

The tendency of a few-shot prompt to favour the label that appears most often, or last, among its examples.

In more detail

Zhao and colleagues described it in 2021 in "Calibrate Before Use", along with a bias towards common tokens. Balance the labels in your examples, vary their order and measure on held-out data.

Related terms

Taught in

References

Certification courses