GPU

A processor with thousands of small cores that run the same operation in parallel, used for graphics and for training and running AI models.

In more detail

GPU stands for graphics processing unit. Model inference is mostly large matrix multiplications, which GPUs do far faster than a CPU, so the size of a model you can run locally depends on your GPU's memory. Browsers also use the GPU to draw and composite pages.

Related terms

Taught in

References

Certification courses