|------------| |KAFKA TOPICS| |------------| 1. list topics -------------- kafka-topics.sh --list --bootstrap-server 192.168.70.21:9092 kafka-topics.bat --list --bootstrap-server 192.168.70.21:9092 2. create your topic - use your surname as suffix ------------------------------------------------- kafka-topics.sh --create --topic test_{surname} --bootstrap-server 192.168.70.21:9092 kafka-topics.bat --create --topic test_{surname} --bootstrap-server 192.168.70.21:9092 3. view information about your topic ------------------------------------ kafka-topics.sh --describe --topic test_{surname} --bootstrap-server 192.168.70.21:9092 kafka-topics.bat --describe --topic test_{surname} --bootstrap-server 192.168.70.21:9092 4. view information about topics test_3p2r and test_6p1r -------------------------------------------------------- kafka-topics.sh --describe --topic test_3p2r --bootstrap-server 192.168.70.21:9092 kafka-topics.bat --describe --topic test_3p2r --bootstrap-server 192.168.70.21:9092 kafka-topics.sh --describe --topic test_6p1r --bootstrap-server 192.168.70.21:9092 kafka-topics.bat --describe --topic test_6p1r --bootstrap-server 192.168.70.21:9092 |------------------------------| |PRODUCING / CONSUMING MESSAGES| |------------------------------| 5. produce messages to your kafka topic ----------------------------------------- kafka-console-producer.sh --topic test_{surname} --bootstrap-server 192.168.70.21:9092 > Message 1 > Message 2 > Message 3 > Message 4 > .... Ctrl + C 6. consume messages from your kafka topic (new terminal window) ----------------------------------------------------------------- kafka-console-consumer.sh --topic test_{surname} --from-beginning --bootstrap-server 192.168.70.21:9092 7. consume messages from your kafka topic + view partition of each message -------------------------------------------------------------------------------- kafka-console-consumer.sh --topic test_{surname} --from-beginning --property print.partition=true --bootstrap-server 192.168.70.21:9092 8. consume messages from kafka topic test_many ---------------------------------------------- kafka-console-consumer.sh --topic test_many --from-beginning --property print.partition=true --bootstrap-server 192.168.70.21:9092 |------------------| |MESSAGES WITH KEYS| |------------------| 9. create your topic with "keys" suffix --------------------------------------- kafka-topics.sh --create --topic test_{surname}_keys --bootstrap-server 192.168.70.21:9092 10. produce messages with keys to your kafka topic ------------------------------------------------- kafka-console-producer.sh --topic test_{surname}_keys --property "parse.key=true" --property "key.separator=:" --bootstrap-server 192.168.70.21:9092 > Key1:Message 1 > Key2:Message 2 > Key1:Message 3 > Key1:Message 4 > Key3:Message 5 > Key2:Message 6 > Key2:Message 7 > Key3:Message 8 CTRL + C 11. consume messages with keys from your kafka topic ---------------------------------------------------- kafka-console-consumer.sh --topic test_{surname}_keys --from-beginning --property print.partition=true --property print.key=true --bootstrap-server 192.168.70.21:9092 |---------------| |CONSUMER GROUPS| |---------------| 12. consume messages through your consumer group --------------------------------------------- (one terminal windows) kafka-console-consumer.sh --topic test_many --property print.partition=true --group group_{surname} --bootstrap-server 192.168.70.21:9092 (second terminal window) kafka-console-consumer.sh --topic test_many --property print.partition=true --group group_{surname} --bootstrap-server 192.168.70.21:9092 13. view information about your consumer group ---------------------------------------------- kafka-consumer-groups.sh --describe --group group_{surname} --bootstrap-server 192.168.70.21:9092 14. stop one consumer and watch what happens with the second one ---------------------------------------------------------------- 15. delete your consumer group --------------------------------------------- kafka-consumer-groups.sh --delete --group group_{surname} --bootstrap-server 192.168.70.21:9092