throttling
A service refusing or delaying requests because a rate or concurrency limit has been reached.
In more detail
Lambda throttles invocations above its concurrency limit; DynamoDB throttles requests above its capacity or on a hot partition. Throttles are a metric worth watching, because they show demand hitting a limit before users complain.
Related terms
- Lambda concurrency — How many copies of a function are running at the same moment, which Lambda caps with an account and optional per-function quota.
- service quota — A limit a cloud provider sets on how much of a resource one account may use, such as how many processors or networks per region.
- hot partition — A partition that gets far more traffic than the others because many requests use the same key, causing throttling even when total capacity is free.
- rate limiting — Capping how many requests a client may make in a period of time, and rejecting or delaying the rest.
- quota — A total allowance of use over a long period, such as a number of requests per day or month.
- load shedding — Deliberately rejecting some requests when overloaded so the requests that are accepted can still be served well.
Taught in
- Scaling Patterns: When Capacity Arrives Too Late — AWS Certified DevOps Engineer – Professional (DOP-C02) Exam Prep
- EventBridge Rules: The Rule That Matched Nothing — AWS Certified DevOps Engineer – Professional (DOP-C02) Exam Prep
- KMS And Envelope Encryption: Who Can Still Decrypt? — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Serverless And Container Patterns: Where The Limits Bite — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Compute Performance: Families, Placement And Lambda Memory — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Database Performance: Caches, Proxies And Capacity Units — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Ingest And Transform: Streams, Lakes And Partitions — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- The Performance Clinic: Five Slow Systems, Five Fixes — AWS Certified Solutions Architect – Associate (SAA-C03) Exam Prep
- Serverless Compute (Lambda) — Cloud Infrastructure & Hyperscaler Architecture
- NoSQL and DynamoDB — Cloud Infrastructure & Hyperscaler Architecture
- Back Of The Envelope Estimation: Storage And Bandwidth — Scalable System Design & Distributed Architecture
References
- Understanding Lambda function scaling
- DynamoDB: troubleshooting throttling
- Azure Architecture Center: Throttling pattern
- MDN Web Docs glossary: Throttle