This video explains the technique to read messages from a Kafka topic using multiple consumers in parallel, maintaining the order of messages, and without reading duplicate messages across consumers. The concepts of Kafka consumer groups and Kafka partitions are explained in detail.
The concept is demonstrated technically using producer and consumer programs written in Python programming language.
🎥 Chapters to explore
00:00:00 Introduction
00:00:43 Challenges while scaling Kafka consumers
00:02:44 Partitions and Consumer Groups in Kafka - Explained
00:09:34 Key points to understand while using Kafka
00:11:30 Practical demonstration
💻 Code and presentation are available in GitHub: https://github.com/coderinboots/kafka-producer-consumer.git
Install Kafka for practice in 5 minutes: ▶️ https://youtu.be/2nrmPY-ZOFQ
🤝 Stay connected and level up your computer engineering skills
Explore more videos on Kafka:
https://youtube.com/playlist?list=PLmE57RrRLCslbj5HNobZvEWhc2HLnwZ1g&si=7Gi8WBV0k2ES6FrI
Subscribe Now: ▶️https://www.youtube.com/@UCE_Sny48RIaPMfh-8LO5jYQ
Instagram: https://instagram.com/coderinboots
Facebook: https://www.facebook.com/coderinboots
Website: https://coderinboots.com
#kafka #partitioning #consumergroups #consumer #scaling #coderinboots
Download
0 formats
No download links available.
Maintain message order and avoid duplicates while using multiple Kafka consumers on same Kafka topic | NatokHD