There are lots of guides out there describing how to set up simple Apache Kafka configurations but they generally stop short of describing how to use this with a three Apache ZooKeeper quorum so that ZooKeeper isn’t a single point of failure. The configuration of machines that I am working with are running these components:
- Server1 (static 192.168.10.11) – ZooKeeper
- Server2 (static 192.168.10.12) – ZooKeeper
- Server3 (static 192.168.10.13) – ZooKeeper, Kafka broker
- Desktop (static 192.168.10.14) – Kafka producer and Kafka consumer
This setup doesn’t use multiple Kafka brokers but that’s a relatively simple extension.