neural network

A model built from layers of simple numeric units whose connection weights are learned from data.

In more detail

Modern language models are transformer neural networks: each layer uses attention to weigh every earlier token when computing the next representation. Training sets billions of weights, and those weights are what an open-weight release publishes.

Related terms

Taught in

References

Certification courses