Kubernetes RabbitMQ Operator部署的集群启动失败(就绪探针检测不通过)排查求助
Kubernetes RabbitMQ Operator部署的集群启动失败(就绪探针检测不通过)排查求助
我最近碰到个棘手的问题:用官方RabbitMQ Operator部署的集群一直没法进入就绪状态,就绪探针持续失败,启动过程明显卡壳了。
部署背景
我用的是官方RabbitMQ Operator,部署配置基本就是官方的HelloWorld示例,只额外指定了NFS存储类,具体配置如下:
cat <<EOF | kubectl apply -f - apiVersion: rabbitmq.com/v1beta1 kind: RabbitmqCluster metadata: name: why-not-ready spec: persistence: storageClassName: nfs-client --- EOF
当前日志情况
容器启动日志只输出到某一步就报错,完全没有能定位问题的有效信息:
rabbitmq 09:06:44.95 rabbitmq 09:06:44.96 Welcome to the Bitnami rabbitmq container rabbitmq 09:06:44.96 Subscribe to project updates by watching https://github.com/bitnami/containers rabbitmq 09:06:44.96 Submit issues and feature requests at https://github.com/bitnami/containers/issues rabbitmq 09:06:44.96 rabbitmq 09:06:44.96 INFO ==> ** Starting RabbitMQ setup ** rabbitmq 09:06:44.98 INFO ==> Validating settings in RABBITMQ_* env vars.. rabbitmq 09:06:44.99 INFO ==> Initializing RabbitMQ... rabbitmq 09:06:45.03 INFO ==> Starting RabbitMQ in background... rabbitmq 09:09:03.93 ERROR ==> Couldn't start RabbitMQ in background.
尝试过的调试操作
我试着添加了调试级别的日志配置,希望能拿到更多输出,但结果还是一样,没有额外日志:
cat <<EOF | kubectl apply -n rabbitmq -f - apiVersion: rabbitmq.com/v1beta1 kind: RabbitmqCluster metadata: name: why-not-ready spec: persistence: storageClassName: nfs-client rabbitmq: additionalConfig: | log.default.level = debug log.file = false log.console = true log.console.stdio = stdout log.console.level = debug --- EOF
已完成的排查项
我还做了这些排查,暂时没找到问题:
- 初始化容器(setup-container)运行正常,所有配置文件都正确复制到指定路径,内容也没问题:
cat /var/lib/rabbitmq/.erlang.cookie
uxdvZFvkpHFMdAgXM5azu0LOCE283kzY
cat /operator/enabled_plugins
[rabbitmq_peer_discovery_k8s,rabbitmq_prometheus,rabbitmq_management].
cat /var/lib/rabbitmq/.rabbitmqadmin.conf
[default]
username = default_user_l4yC9XizAcUHQEIe3Ep
password = zjvyy5XYCss-kFxu2dCnH2vDrd3AUsbu /var/lib/rabbitmq/mnesia/目录在容器内拥有写权限,而且持久化卷上的内容也能正常更新- 手动执行启动脚本
/opt/bitnami/scripts/rabbitmq/setup.sh,执行到rabbitmq_initialize函数时,也只输出了INFO ==> Starting RabbitMQ in background...这一行,之后就没有任何额外输出了
求助
有没有大佬能帮忙分析下,到底是启动过程中哪个环节出问题了?或者有没有其他办法能开启更详细的调试日志来定位故障?非常感谢!
备注:内容来源于stack exchange,提问作者Philbo
相关产品推荐
相关产品推荐

