Confluent wire format
The framing that schema-registry serializers put in front of each record: a zero magic byte, then a four-byte big-endian schema ID, then the encoded data.
In more detail
The magic byte marks the value as framed this way, and the schema ID tells the consumer which schema to fetch. The five-byte prefix is a convention between clients; the broker ignores it.
Example
struct.pack('>bI', 0, schema_id) + payloadRelated terms
- schema ID — The unique number a schema registry assigns to each distinct schema it stores.
- endianness — The order in which the bytes of a multi-byte number are stored: most significant first (big-endian) or least significant first (little-endian).
- schema registry — A service that stores versioned schemas for Kafka data, gives each a numeric ID and checks new versions against compatibility rules.
- Confluent — A company founded by Kafka's original creators that sells Kafka services and publishes widely used Kafka tools such as Schema Registry.
Taught in
- The Field The Registry Refused — Confluent Apache Kafka Certifications (CCDAK and CCAAK) Exam Prep
- The Schema Registry — Apache Kafka & Event Streaming