poll loop

The loop in which a consumer repeatedly asks the broker for new records and processes them.

In more detail

Each call to poll fetches the next records after the consumer's position. In kafka-python, a for loop over the consumer calls poll for you. If processing between polls takes longer than max.poll.interval.ms, the group assumes the consumer is stuck and rebalances.

Related terms

Taught in

References

Certification courses