Apache Avro
A compact binary serialization format whose schemas are written as JSON documents.
In more detail
Avro records carry only values, in the order the schema lists the fields, so the reader must have the writer's schema to decode them. It has well-defined rules for evolving schemas and is widely used with Kafka and schema registries.
Example
{"type": "record", "name": "Order", "fields": [{"name": "id", "type": "int"}]}Related terms
- schema — A formal description of the structure of data: which fields or columns exist, their types and which are required.
- serialization — Turning an in-memory object into bytes, such as JSON text, that can be sent or stored, and parsing it back again.
- Protocol Buffers — A language-neutral way to define data structures and services in .proto files and encode messages in a compact binary format.
- schema registry — A service that stores versioned schemas for Kafka data, gives each a numeric ID and checks new versions against compatibility rules.
Taught in
- The Field The Registry Refused — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Twelve Lines Instead Of Four Hundred — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- Bytes On The Wire: JSON, Avro And Protobuf — Apache Kafka & Event Streaming
- The Schema Registry — Apache Kafka & Event Streaming