Now, Ajay Shukla will summarise your learning from this session.
In this session, you learnt about the following:
- Topics: Messages are stored in these.
- Partitions: Topics are further divided into partitions, which increases parallelism.
- Producers: They are responsible for writing messages to a partition.
- Consumers: These can subscribe to topics and read messages from them whenever messages are pushed to the topics.
- Consumer groups: Consumers can be grouped together to form consumer groups. When the number of consumers in a group is equal to the number of partitions of a topic, it is the best case of utilisation of resources.
- Rebalancing: Whenever a consumer leaves or a new one joins a consumer group, rebalancing occurs, and all the partitions are reassigned to the consumers.
- Replication: Topics are replicated across different brokers to provide fault tolerance. To replicate topics, you need to specify the replication factor. This factor cannot be more than the number of brokers in the cluster.
The PPT that was used throughout this session is attached below.
Report an error