Kafka生产者持续断开连接问题求助排查

我运行一个基于Kafka Producer的独立Java程序时，生产者持续断开连接。最初遇到Broker not available error，已经通过更新连接地址解决，但目前仍不断出现以下错误日志：

[kafka-producer-network-thread | producer-1] INFO org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1] Node -1 disconnected.
[kafka-producer-network-thread | producer-1] INFO org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 0 due to node -1 being disconnected (elapsed time since creation: 17483ms, elapsed time since send: 17483ms, request timeout: 30000ms)
[kafka-producer-network-thread | producer-1] WARN org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected  
[kafka-producer-network-thread | producer-1] INFO org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1] Node -1 disconnected.
 to node -1 being disconnected (elapsed time since creation: 28755ms, elapsed time since send: 28755ms, request timeout: 30000ms)
[kafka-producer-network-thread | producer-1] WARN org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected  
[main] INFO org.apache.kafka.clients.producer.KafkaProducer - [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.
[kafka-producer-network-thread | producer-1] INFO org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1] Node -1 disconnected.
[kafka-producer-network-thread | producer-1] INFO org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1] Cancelled in-flight API_VERSIONS request with correlation id 2 due to node -1 being disconnected (elapsed time since creation: 21320ms, elapsed time since send: 21320ms, request timeout: 30000ms)
[kafka-producer-network-thread | producer-1] WARN org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected  
[main] INFO org.apache.kafka.common.metrics.Metrics - Metrics scheduler closed
[main] INFO org.apache.kafka.common.metrics.Metrics - Closing reporter org.apache.kafka.common.metrics.JmxReporter
[main] INFO org.apache.kafka.common.metrics.Metrics - Metrics reporters closed
[main] INFO org.apache.kafka.common.utils.AppInfoParser - App info kafka.producer for producer-1 unregistered

排查与解决建议 #

• 检查Broker运行状态：用kafka-topics.sh --list --bootstrap-server localhost:9092测试Broker是否正常响应，确认服务未崩溃。
• 修正Broker监听配置：打开Kafka的server.properties文件，检查listeners参数，确保设置为PLAINTEXT://localhost:9092或PLAINTEXT://0.0.0.0:9092（允许外部访问），避免Broker仅绑定内部IP导致无法连接。
• 调整生产者超时参数：在生产者配置中，将request.timeout.ms调至60000，retry.backoff.ms设为1000，缓解网络延迟引发的断开问题。
• 检查端口防火墙：确认本地防火墙未拦截9092端口，临时关闭防火墙规则测试是否恢复连接。
• 对齐Kafka版本：确保生产者依赖的Kafka客户端版本与Broker版本完全一致，版本不兼容会导致API_VERSIONS请求失败。

内容的提问来源于stack exchange，提问作者user21689957