Kafka protocol
The binary request-and-response protocol over TCP that Kafka clients and brokers use to produce, fetch, commit offsets and read metadata.
In more detail
Any broker that implements this protocol, such as Redpanda, works with standard Kafka clients like kafka-python. Administrative requests such as creating topics or describing groups travel over the same protocol. Record headers, keys and values are fields inside its produce and fetch messages.
Related terms
- Apache Kafka — An open-source platform that stores streams of events in an ordered, replayable log and delivers them to many consumers.
- Redpanda — A streaming data platform, written in C++, that speaks the Kafka protocol so Kafka clients and tools work against it unchanged.
- broker — A server that receives messages from producers, stores them and delivers them to consumers, such as RabbitMQ or Apache Kafka.
- TCP — The internet protocol that delivers data between programs reliably and in order, used by the web and most databases.
Taught in
- Starting A Broker And Reading Its Metadata — Apache Kafka & Event Streaming
- A Producer In Python — Apache Kafka & Event Streaming
- Headers, Envelopes And Event Metadata — Apache Kafka & Event Streaming