ingestion pipeline

The chain of steps that takes a raw log line from its source to a searchable event: collect, buffer, parse, enrich, index and store.

In more detail

Collectors receive events by agent, syslog or API pulls. A buffer queue absorbs bursts and outages, then parsers extract fields, enrichment adds context, and the indexer stores events by time. Evidence is lost at each step if transport drops messages, parsers fail silently or time zones are wrong.

Related terms

Taught in

References