autoscaling
A cloud feature that automatically adds servers when demand rises and removes them when it falls.
In more detail
Rules based on load or a schedule decide how many servers run, so capacity follows demand without anyone intervening. Anything that keeps a written list of servers goes stale as soon as it scales.
Example
A static Ansible inventory cannot keep up with autoscaling; a dynamic inventory asks the provider on every run.Related terms
- dynamic inventory — An inventory produced at run time by a program or plugin, usually by asking a cloud provider, instead of a file maintained by hand.
- cloud provider — A company, such as AWS, Microsoft Azure or Google Cloud, that rents out computers, storage and networks over the internet on demand.
- Kubernetes — An open-source system that runs and manages containers across a cluster of machines.
- cold start — The extra delay when a platform must start a fresh copy of your code or server before it can serve the first request.
- headroom — Capacity kept free above the expected peak, so the system survives deployments, spikes and failures.
- traffic spike — A sudden short rise in requests far above the usual rate.
- cold cache — A cache that is empty or nearly empty, so almost every request misses and goes to the origin.
Taught in
- Dynamic Inventory — Ansible Configuration Management at Scale
- Canary Releases From Replica Counts — Certified Kubernetes Application Developer (CKAD) Exam Prep
- API Deprecations And Migrations — Certified Kubernetes Application Developer (CKAD) Exam Prep
- Bookings That Survive The Pod: Volumes And Claims — Kubernetes and Cloud Native Associate (KCNA) Exam Prep
- Six Times The Traffic: Autoscaling Pods And Nodes — Kubernetes and Cloud Native Associate (KCNA) Exam Prep
- Who Decides What Ships: The CNCF And Its Community — Kubernetes and Cloud Native Associate (KCNA) Exam Prep
- Architecture Sprint: The Refunds Review — Kubernetes and Cloud Native Associate (KCNA) Exam Prep
- Requests, Limits, Quotas And Horizontal Autoscaling — Kubernetes: Production-Grade Container Orchestration
- Taints, Tolerations And Disruption Budgets — Kubernetes: Production-Grade Container Orchestration
- Troubleshooting: Pending Pod Triage — Kubernetes: Production-Grade Container Orchestration
- Containerized Deployment: Multi-Stage Docker Builds — Next.js 15 & Modern App Router Architecture
- Capacity Planning As A Design Input — Scalable System Design & Distributed Architecture
References
- What is Amazon EC2 Auto Scaling?
- Kubernetes: Autoscaling Workloads
- Kubernetes documentation: Horizontal Pod Autoscaling
- Azure Architecture Center: Autoscaling guidance