Apache Kafka启动报错：message.format.version配置值3.0-IV1无效

问题背景 #

在WSL Ubuntu 18环境下运行Apache Kafka，启动时突然出现配置错误，尝试删除tmp/kafka-logs、检查server.properties、升级Kafka版本均无效。

核心报错信息 #

org.apache.kafka.common.config.ConfigException: Invalid value 3.0-IV1 for configuration message.format.version: Version 3.0-IV1 is not a valid version

完整启动日志 #

[2023-08-10 12:24:12,421] INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:12,421] INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:12,422] INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:12,542] ERROR [KafkaServer id=0] Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
org.apache.kafka.common.config.ConfigException: Invalid value 3.0-IV1 for configuration message.format.version: Version `3.0-IV1` is not a valid version
        at kafka.api.ApiVersionValidator$.ensureValid(ApiVersion.scala:361)
        at org.apache.kafka.common.config.ConfigDef.parseValue(ConfigDef.java:484)
        at org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:468)
        at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:108)
        at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:142)
        at kafka.log.LogConfig.<init>(LogConfig.scala:71)
        at kafka.log.LogConfig$.fromProps(LogConfig.scala:314)
        at kafka.zk.KafkaZkClient.$anonfun$getLogConfigs$2(KafkaZkClient.scala:313)
        at scala.collection.IterableOnceOps.foreach(IterableOnce.scala:553)
        at scala.collection.IterableOnceOps.foreach$(IterableOnce.scala:551)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:920)
        at kafka.zk.KafkaZkClient.getLogConfigs(KafkaZkClient.scala:308)
        at kafka.log.LogManager$.apply(LogManager.scala:1090)
        at kafka.server.KafkaServer.startup(KafkaServer.scala:273)
        at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44)
        at kafka.Kafka$.main(Kafka.scala:82)
        at kafka.Kafka.main(Kafka.scala)
[2023-08-10 12:24:12,544] INFO [KafkaServer id=0] shutting down (kafka.server.KafkaServer)
[2023-08-10 12:24:12,546] INFO [ZooKeeperClient Kafka server] Closing. (kafka.zookeeper.ZooKeeperClient)
[2023-08-10 12:24:12,660] INFO Session: 0x1000006a11f0002 closed (org.apache.zookeeper.ZooKeeper)
[2023-08-10 12:24:12,660] INFO EventThread shut down for session: 0x1000006a11f0002 (org.apache.zookeeper.ClientCnxn)
[2023-08-10 12:24:12,661] INFO [ZooKeeperClient Kafka server] Closed. (kafka.zookeeper.ZooKeeperClient)
[2023-08-10 12:24:12,662] INFO [ThrottledChannelReaper-Fetch]: Shutting down (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:13,422] INFO [ThrottledChannelReaper-Fetch]: Stopped (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:13,422] INFO [ThrottledChannelReaper-Fetch]: Shutdown completed (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:13,422] INFO [ThrottledChannelReaper-Produce]: Shutting down (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:14,421] INFO [ThrottledChannelReaper-Produce]: Stopped (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:14,421] INFO [ThrottledChannelReaper-Produce]: Shutdown completed (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:14,422] INFO [ThrottledChannelReaper-Request]: Shutting down (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:14,422] INFO [ThrottledChannelReaper-Request]: Stopped (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:14,422] INFO [ThrottledChannelReaper-Request]: Shutdown completed (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
[2023-08-10 12:24:14,429] INFO [KafkaServer id=0] shut down completed (kafka.server.KafkaServer)
[2023-08-10 12:24:14,430] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
[2023-08-10 12:24:14,430] INFO [KafkaServer id=0] shutting down (kafka.server.KafkaServer)

问题原因 #

从日志中kafka.zk.KafkaZkClient.getLogConfigs的调用路径可知，Kafka启动时会优先从ZooKeeper读取topic级别的自定义配置，而非仅依赖本地server.properties。错误的message.format.version=3.0-IV1配置存储在ZooKeeper中，导致启动时版本验证失败。

解决步骤 #

1. 启动ZooKeeper客户端：

   zkCli.sh
   

2. 查看所有存在自定义配置的topic：

   ls /config/topics
   

3. 逐个检查每个topic的配置，定位包含3.0-IV1的条目：

   get /config/topics/[你的topic名称]
   

4. 删除该topic的错误配置：

   delete /config/topics/[你的topic名称]
   

   注意：若所有topic都不需要自定义格式版本，可执行deleteall /config/topics清除所有topic的自定义配置，但此操作会移除所有topic的自定义参数，需谨慎执行。

5. 退出ZooKeeper客户端：

   quit
   

6. 重启ZooKeeper和Kafka服务。

内容的提问来源于stack exchange，提问作者Varun Sharma