Apache Kafka Consumer Group

Consumer Group Nedir?

Açıklaması şöyle. Her consumer'a bir veya daha fazla Partition atanır

What if we have many consumers, but we would like to read the message only once? That is why the concept of consumer group was designed. The idea here is when a consumer belongs to the same group, it will have some subset of partitions assigned to read a message. That helps to avoid the situation of duplicated reads. In the figure below, there is an example of how we can scale data consumption from the topic. When a consumer is making time-consuming operations, we can connect other consumers to the group, which helps to process faster all new events on the consumer level. We have to be careful, though, when we have a too-small number of partitions. We would not be able to scale it up. It means if we have more consumers than partitions, they are idle.

Consumer Group Birden Fazla Topic'i Dinleyebilir

Açıklaması şöyle

A consumer group can subscribe to one or more topics.

Consumer Group'ta Kaç Tane Consumer Olmalı?

Partition sayısı kadar consumer olmalı. Daha  fazla sayıda consumer varsa bunlar idle beklerler. 

Şeklen şöyle

Rebalance Nedir?

Apache Kafka Rebalancing Protocol yazısına taşıdım