Docker容器内Java Kafka消费者无法连接外部Kafka服务器求助

Hey there! Let's clear up the confusion first and then fix your connection problem.

First: That SSH Test Error Isn't a Port Limit #

The error you see in Kafka's logs when running ssh -p 9092 192.168.1.251 from the container has nothing to do with port restrictions. Here's why:

• Kafka uses its own binary protocol for communication, not the SSH protocol. When you send SSH handshake data to Kafka's port, it can't parse the incoming data (the size value in the error is actually the SSH protocol's magic number, not a real oversized message).
• To properly test port connectivity, use tools like nc (netcat) instead:

  root@ff419d41540a:~# nc -zv 192.168.1.251 9092
  

  This will tell you if the port is reachable without triggering protocol errors.

The Real Issue: Kafka's advertised.listeners Configuration #

The core problem is how Kafka tells consumers where to connect. When using Docker's default bridge network (not host), Kafka is probably advertising an internal or localhost address that your container can't resolve correctly.

Why --network=host Works

When you use host networking, your container shares the exact same network stack as your physical server. So when Kafka advertises localhost:9092 or the server's IP, your consumer can directly reach it—no network translation needed.

Step-by-Step Fix #

To get your consumer working with Docker's standard network, adjust Kafka's configuration:

1. Edit Kafka's server.properties file (usually located in your Kafka installation's config directory):

   • Set listeners to listen on all network interfaces:

     listeners=PLAINTEXT://0.0.0.0:9092
     

   • Set advertised.listeners to your physical server's actual IP address (the one your container can reach, e.g., 192.168.1.251):

     advertised.listeners=PLAINTEXT://192.168.1.251:9092
     

   This ensures Kafka tells consumers to connect to the correct, reachable IP instead of an internal or localhost address.

2. Restart your Kafka service to apply the changes.

3. Update your Java consumer's configuration:

   • Set bootstrap.servers to your physical server's IP and port:

     props.put("bootstrap.servers", "192.168.1.251:9092");
     

     Don't use localhost:9092 here—inside the container, localhost refers to the container itself, not your physical server.

Verify the Fix #

After making these changes, start your Docker container (without --network=host) and test the consumer. It should now successfully connect to your physical server's Kafka instance.

内容的提问来源于stack exchange，提问作者Helio Aymoto