GPU
A processor with thousands of small cores that run the same operation in parallel, used for graphics and for training and running AI models.
In more detail
GPU stands for graphics processing unit. Model inference is mostly large matrix multiplications, which GPUs do far faster than a CPU, so the size of a model you can run locally depends on your GPU's memory. Browsers also use the GPU to draw and composite pages.
Related terms
- inference — Running a trained model to produce output for new input, as opposed to training it.
- open-weight model — A model whose trained weights, the learned numbers that define it, are published so anyone can download and run it under its licence.
- compositing — The final rendering stage, in which separately painted layers are stacked and drawn together on screen, usually by the GPU.
- compositor thread — A browser thread, separate from the main thread, that combines layers into frames and can scroll and run some animations on its own.
- CPU — The chip in a computer that runs program instructions; a machine can have several.
Taught in
- What An AI Engineer Does — AI Engineering: LLM Apps, RAG & Agents
- Nine Jobs, Not Nine Servers — AWS Certified Cloud Practitioner (CLF-C02) Exam Prep
- The Public Subnet That Was Not — AWS Certified Cloud Practitioner (CLF-C02) Exam Prep
- Confusable Services Sprint: One Clue Each — AWS Certified Cloud Practitioner (CLF-C02) Exam Prep
- The Edge: WAF, Shield, CloudFront And GuardDuty — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Route 53 Routing: Where Does A Fan In Lagos Land? — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Compute Performance: Families, Placement And Lambda Memory — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Database Performance: Caches, Proxies And Capacity Units — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Network Performance: Peering, Transit Gateway And The Edge — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- The Performance Clinic: Five Slow Systems, Five Fixes — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Database Cost: Serverless, Capacity Modes And Reservations — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Two Domain Controllers, One Host: Virtualisation — CompTIA Cloud+ (CV0-004) Exam Prep
- CSS Parsing, The CSSOM And The Render Tree — Frontend Architecture & Web Platform
- Layout, Reflow, Paint And GPU Compositing Layers — Frontend Architecture & Web Platform
- Modern CSS Animations, Transitions And View Transitions API — Frontend Architecture & Web Platform
- Passive Listeners, Scroll Performance And Touch Interactions — Frontend Architecture & Web Platform
- Organisation, Folders And Projects — Google Cloud Associate Cloud Engineer Exam Prep
- APIs, Quotas, Locations And Inventory — Google Cloud Associate Cloud Engineer Exam Prep
- Choosing Compute — Google Cloud Associate Cloud Engineer Exam Prep
- Running Compute Engine — Google Cloud Associate Cloud Engineer Exam Prep
- Running GKE — Google Cloud Associate Cloud Engineer Exam Prep
- GitHub-Hosted And Larger Runners: Specs, Software And Networks — GitHub Actions (GH-200) Exam Prep
- Self-Hosted Runners At Scale: Labels, Groups And ARC — GitHub Actions (GH-200) Exam Prep
- Registering Runners And Routing Jobs With Tags — GitLab Certified CI/CD Associate Exam Prep
- Where Do The Tasks Land? Labels, Constraints And Templates — Docker Certified Associate (DCA) Exam Prep
- Stuck In Pending: Troubleshooting Services And Reading docker inspect — Docker Certified Associate (DCA) Exam Prep
- Orchestration Sprint: Eight Calls In Eight Minutes — Docker Certified Associate (DCA) Exam Prep
- A Card With No Driver, A Stick With Too Much: Devices And Kernel Modules — CompTIA Linux+ (XK0-006) Exam Prep
References
Certification courses
- AWS AIP-C01 course and practice exam: AI engineering with LLM apps, RAG and agents
- AWS Cloud Practitioner course and practice exam: CLF-C02
- AWS Solutions Architect Associate course and practice exam: SAA-C03
- CompTIA Cloud+ course and practice exam: CV0-004
- Google Associate Cloud Engineer course and practice exam: Google Cloud certification
- GH-200 course and practice exam: GitHub Actions
- GitLab CI/CD Associate course and practice exam: GitLab Certified CI/CD Associate
- DCA course and practice exam: Docker Certified Associate
- CompTIA Linux+ course and practice exam: XK0-006