restart storm
Many instances being restarted over and over because a shared dependency is down, making an outage worse.
In more detail
Restarting cannot fix an outside dependency, so the restarts only add load. It happens when liveness probes check dependencies; readiness is the right place for them.
Related terms
- liveness probe — A health check that answers only whether a process is alive enough to keep running; if it keeps failing, the orchestrator, such as Kubernetes, restarts it.
- readiness probe — A check that decides whether a pod should receive traffic right now; failing it removes the pod from its Service without restarting it.
Taught in
- Health Checks — Modern .NET Core, C# & Enterprise Microservices