登录后无法发送Kafka消息：本地集群连接地址异常排查

场景与配置 #

在Rancher Desktop环境中，通过Bitnami Helm Chart部署了单节点Kafka集群，使用的values.yaml配置如下：

controller:
  replicaCount: 1
  persistence:
    size: 1Gi
  podSecurityContext:
    enabled: false
  containerSecurityContext:
    enabled: false
  resources:
    limits:
      memory: 2Gi
  automountServiceAccountToken: true

externalAccess:
  enabled: true
  service:
    type: LoadBalancer
    ports:
      external: 9094
  autoDiscovery:
    enabled: true

broker:
  podSecurityContext:
    enabled: false
  containerSecurityContext:
    enabled: false

sasl:
  client:
    users: [ "myuser" ]
    passwords: [ "mypassword" ]

rbac:
  create: true

# siehe https://github.com/bitnami/charts/issues/19522
extraConfig: |
  deleteTopicEnable=true
  auto.create.topics.enable=false
  offsets.topic.replication.factor=1
  transaction.state.log.replication.factor=1

provisioning:
  enabled: true
  topics:
    - name: heartBeat

问题现象 #

Spring Boot应用启动后可成功登录Kafka并初始化生产者，但无法发送消息。日志显示客户端尝试连接192.168.127.2:9094，但实际仅localhost:9094可访问Kafka服务：

[2025-04-15 10:37:26,497] [kafka-producer-network-thread | producer-1] severity=WARN - org.apache.kafka.clients.NetworkClient.processDisconnection - traceid= - [Producer clientId=producer-1] Connection to node 0 (192.168.127.2/192.168.127.2:9094) could not be established. Node may not be available.

解决方案 #

1. 修改Kafka集群配置，指定外部访问地址 #

问题根源是Kafka将内部Pod IP作为advertised.listeners返回给客户端，导致客户端尝试连接不可达的内部地址。需修改values.yaml的externalAccess配置，强制Kafka使用localhost作为外部访问的广告地址：

externalAccess:
  enabled: true
  service:
    type: LoadBalancer
    ports:
      external: 9094
  autoDiscovery:
    enabled: true
  # 添加以下配置，指定外部访问域名
  external:
    domain: localhost

或者直接指定LoadBalancer的静态IP为localhost：

externalAccess:
  enabled: true
  service:
    type: LoadBalancer
    ports:
      external: 9094
    loadBalancerIP: 127.0.0.1
  autoDiscovery:
    enabled: true

更新部署：

helm upgrade kafka bitnami/kafka -f values.yaml

2. 在客户端配置地址映射 #

若不想修改Kafka集群配置，可在Spring Boot客户端的配置文件中添加地址映射，让客户端将内部IP转换为localhost：

spring:
  kafka:
    producer:
      properties:
        bootstrap.servers: localhost:9094
        # 将内部IP映射到localhost
        client.override.hostname: "192.168.127.2:9094=localhost:9094"
        socket.connection.setup.timeout.ms: 30000

也可以通过修改本地hosts文件实现全局映射：

• Windows：编辑C:\Windows\System32\drivers\etc\hosts，添加127.0.0.1 192.168.127.2
• Linux/macOS：编辑/etc/hosts，添加127.0.0.1 192.168.127.2

3. 验证配置生效 #

更新配置后，可通过以下命令检查Kafka的advertised.listeners是否正确：

kubectl exec -it kafka-controller-0 -- cat /opt/bitnami/kafka/config/server.properties | grep advertised.listeners

确保输出包含PLAINTEXT://localhost:9094（或对应的外部访问地址）。

内容的提问来源于stack exchange，提问作者BetaRide