Back to Browse

Maintain message order and avoid duplicates while using multiple Kafka consumers on same Kafka topic

755 views
Jan 1, 2025
27:32

This video explains the technique to read messages from a Kafka topic using multiple consumers in parallel, maintaining the order of messages, and without reading duplicate messages across consumers. The concepts of Kafka consumer groups and Kafka partitions are explained in detail. The concept is demonstrated technically using producer and consumer programs written in Python programming language. 🎥 Chapters to explore 00:00:00 Introduction 00:00:43 Challenges while scaling Kafka consumers 00:02:44 Partitions and Consumer Groups in Kafka - Explained 00:09:34 Key points to understand while using Kafka 00:11:30 Practical demonstration 💻 Code and presentation are available in GitHub: https://github.com/coderinboots/kafka-producer-consumer.git Install Kafka for practice in 5 minutes: ▶️ https://youtu.be/2nrmPY-ZOFQ 🤝 Stay connected and level up your computer engineering skills Explore more videos on Kafka: https://youtube.com/playlist?list=PLmE57RrRLCslbj5HNobZvEWhc2HLnwZ1g&si=7Gi8WBV0k2ES6FrI Subscribe Now: ▶️https://www.youtube.com/@UCE_Sny48RIaPMfh-8LO5jYQ Instagram: https://instagram.com/coderinboots Facebook: https://www.facebook.com/coderinboots Website: https://coderinboots.com #kafka #partitioning #consumergroups #consumer #scaling #coderinboots

Download

0 formats

No download links available.

Maintain message order and avoid duplicates while using multiple Kafka consumers on same Kafka topic | NatokHD