observability
How well you can understand what a system is doing, and why, from the data it emits: mainly logs, metrics and traces.
In more detail
Monitoring tells you that something changed; observability lets you ask why. Each signal needs shared context, such as a request identifier, operation name, status and duration, while sensitive values stay out.
Examples
In AWS: How well you can understand what a running system is doing, and why, from the signals it produces: metrics, logs and traces.The deploy test: if answering "why was checkout slow for one customer this morning?" needs a code change and a release, the system was not observable for that question.Related terms
- log — A time-stamped record of an individual event in a system, such as one request being handled; structured logs record it as named fields rather than free text.
- metric — A number measured over time, such as requests per second or error count, that shows how a system behaves in aggregate.
- trace — A record of one request’s whole journey through a system, made of nested spans that show where the time went.
- monitoring — Continuously collecting and watching measurements of a system so problems are noticed quickly.
- correlation ID — A unique value attached to one request and passed along everywhere it goes, so its logs and traces can be found together.
- error rate — The share of requests that fail, reported alongside latency so a fast result is not mistaken for a healthy one.
- latency — The time between asking for something and getting the answer back.
- health status — Argo CD's verdict on whether a resource works: Healthy, Progressing, Degraded, Suspended, Missing or Unknown.
- Amazon CloudWatch — The AWS monitoring service that collects metrics and logs from AWS resources and applications and raises alarms on them.
- telemetry — The data a running system sends out about itself, such as logs, metrics and traces.
- OpenTelemetry — A vendor-neutral, open-source standard and set of tools for producing traces, metrics and logs and sending them to any backend.
- distributed tracing — Following one request across every service, queue and database it touches by recording linked spans that share a trace identifier.
- structured logging — Writing each log entry as named fields, such as status, duration and request identifier, instead of a free-text sentence.
- deploy test — A practical test of observability: can a brand-new question be answered without changing code and deploying a release?
- telemetry signal — One of the three main kinds of telemetry: metrics, logs or traces.
- logging — Recording individual events in detail, such as one failed order, as text or structured lines.
- four golden signals — Latency, traffic, errors and saturation: the four measurements every service should emit.
Taught in
- What An AI Engineer Does — AI Engineering: LLM Apps, RAG & Agents
- Guardrails, Privacy And Governance — AI Engineering: LLM Apps, RAG & Agents
- Actions That Do Not Fit CRUD — Modern API Architecture: REST, GraphQL & gRPC
- API Gateways And Proxies — Modern API Architecture: REST, GraphQL & gRPC
- Observability: Logs, Metrics, Traces — Modern API Architecture: REST, GraphQL & gRPC
- A Bake-Off With One Rule: Argo CD And Flux — Certified GitOps Associate (CGOA) Exam Prep
- A Rollback Nobody Heard: Notifications, Observability And CI — Certified GitOps Associate (CGOA) Exam Prep
- The Push Model vs. The Pull Model — Continuous Integration & Continuous Delivery Pipelines
- Drift Detection and Self-Healing — Continuous Integration & Continuous Delivery Pipelines
- Serverless Compute (Lambda) — Cloud Infrastructure & Hyperscaler Architecture
- Auto Scaling Groups — Cloud Infrastructure & Hyperscaler Architecture
- Observability with CloudWatch — Cloud Infrastructure & Hyperscaler Architecture
- Metrics, Logs, and Alarms — Cloud Infrastructure & Hyperscaler Architecture
- Infrastructure as Code (Handover to Terraform) — Cloud Infrastructure & Hyperscaler Architecture
- Deployment Sprint: A Plan That Deletes The App Server — CompTIA Cloud+ (CV0-004) Exam Prep
- Slow At Lunchtime: Logs, Traces And Alerts — CompTIA Cloud+ (CV0-004) Exam Prep
- No Patch Is Coming: The Life Cycle Of Cloud Resources — CompTIA Cloud+ (CV0-004) Exam Prep
- Operations Sprint: Twelve Servers, Two Hours — CompTIA Cloud+ (CV0-004) Exam Prep
- DevOps Sprint: Tax At A Hundred Percent — CompTIA Cloud+ (CV0-004) Exam Prep
- SDLC: From Request To Running Software — DevOps & Site Reliability Engineering
- Continuous Delivery Versus Continuous Deployment — DevOps & Site Reliability Engineering
- Containers And Orchestration Context — DevOps & Site Reliability Engineering
- Pipelines And GitOps Context — DevOps & Site Reliability Engineering
- Observability Context — DevOps & Site Reliability Engineering
- OpenTelemetry, Container Publishing and Trimming — Modern .NET Core, C# & Enterprise Microservices
- Distributed Tracing: OpenTelemetry & Traceparent — Production Full-Stack Engineering
- Structured Logging & Correlation IDs: Context Stitching — Production Full-Stack Engineering
- Close Phase & Signal Dispatch: Sockets & Teardown — Node.js Internals & Backend Services
- Routing & Middleware: Path Parsing & Async Context — Node.js Internals & Backend Services
- Observability Versus Monitoring — Full-Stack Observability: Metrics, Tracing & Logging
- The OpenTelemetry Collector — Full-Stack Observability: Metrics, Tracing & Logging
- Fifteen Traces For Six Bookings: Where Context Was Lost — OpenTelemetry Certified Associate (OTCA) Exam Prep
- Ninety Minutes, No Question Count: Exam Strategy — OpenTelemetry Certified Associate (OTCA) Exam Prep
- A Warning With An Address: Correlating Signals — OpenTelemetry Certified Associate (OTCA) Exam Prep
- Fundamentals Sprint: One Declined Card — OpenTelemetry Certified Associate (OTCA) Exam Prep
- Four Bookings Or Two: Instruments And Temporality — OpenTelemetry Certified Associate (OTCA) Exam Prep
- API And SDK Sprint: Fourteen Predictions — OpenTelemetry Certified Associate (OTCA) Exam Prep
- Forty Four Of Sixty: The Mock And What It Tells You — OpenTelemetry Certified Associate (OTCA) Exam Prep
- Six Minutes Nobody Saw: Prometheus In One Outage — Prometheus Certified Associate (PCA) Exam Prep
- Ninety Minutes, No Question Count: Exam Strategy — Prometheus Certified Associate (PCA) Exam Prep
- Forty Seconds At Two: Push, Pull And Service Discovery — Prometheus Certified Associate (PCA) Exam Prep
- Ninety Nine Percent Of What? SLIs, SLOs And SLAs — Prometheus Certified Associate (PCA) Exam Prep
- Observability Sprint: One Failed Checkout — Prometheus Certified Associate (PCA) Exam Prep
- Instrumentation Sprint: Sixteen Calls On Code And Exporters — Prometheus Certified Associate (PCA) Exam Prep
- Seventy Seven Percent, Book Now? The Full Mock — Prometheus Certified Associate (PCA) Exam Prep
- What A Design Is For, And How To Run A Design Discussion — Scalable System Design & Distributed Architecture
- The Storage Decision: Relational Versus Document — Scalable System Design & Distributed Architecture
- Partitioning, Sharding And Hot Keys — Scalable System Design & Distributed Architecture
- Eventual Consistency And What It Costs A Product — Scalable System Design & Distributed Architecture
- Queues, Events And Asynchronous Work — Scalable System Design & Distributed Architecture
- The Difference Between A Queue And A Log — Scalable System Design & Distributed Architecture
- Timeouts, And Avoiding Cascaded Failure — Scalable System Design & Distributed Architecture
- Retries, Backoff And Jitter — Scalable System Design & Distributed Architecture
- Circuit Breakers — Scalable System Design & Distributed Architecture
- Monolith Versus Services: The Honest Trade Offs — Scalable System Design & Distributed Architecture
- Observability As A Design Input — Scalable System Design & Distributed Architecture
- Worked Design Three: A Metrics Ingestion Pipeline — Scalable System Design & Distributed Architecture
References
- OpenTelemetry: Observability primer
- AWS Observability Best Practices
- AWS Well-Architected Operational Excellence pillar: implement observability
- DORA capability: monitoring and observability
- OpenTelemetry: what is OpenTelemetry?
- Google SRE book: Monitoring Distributed Systems
Certification courses
- AWS AIP-C01 course and practice exam: AI engineering with LLM apps, RAG and agents
- CGOA course and practice exam: Certified GitOps Associate
- CompTIA Cloud+ course and practice exam: CV0-004
- OTCA course and practice exam: OpenTelemetry Certified Associate
- PCA course and practice exam: Prometheus Certified Associate