如何在Docker部署的Airflow中正常显示DAG Processor状态
Docker部署Airflow集群:DAG Processor状态显示Unknown的排查与解决
我通过Docker运行Airflow 2.7.1集群,其余组件均运行正常,仅DAG Processor状态在集群页面显示为Unknown:
已完成以下排查步骤:
- 所有组件均处于健康运行状态,执行
docker ps | grep airflow结果如下:
docker ps | grep airflow b3945b8cd533 apache/airflow:2.7.1 "/usr/bin/dumb-init …" 3 days ago Up 3 days (healthy) 8080/tcp airflow_airflow-webserver_1 c19eb3571734 apache/airflow:2.7.1 "/usr/bin/dumb-init …" 3 days ago Up 3 days (healthy) 8080/tcp airflow_airflow-worker_1 07403ea2cdd0 apache/airflow:2.7.1 "/usr/bin/dumb-init …" 3 days ago Up 3 days (healthy) 8080/tcp airflow_airflow-scheduler_1 6b53355eae24 apache/airflow:2.7.1 "/usr/bin/dumb-init …" 3 days ago Up 3 days (healthy) 8080/tcp airflow_airflow-triggerer_1 1f8dfbc2766b redis:latest "docker-entrypoint.s…" 4 days ago Up 4 days (healthy) 6379/tcp airflow_airflow-cache_1 53c2926b6eea postgres:16 "docker-entrypoint.s…" 4 days ago Up 4 days (healthy) 5432/tcp airflow_airflow-database_1
- 已确认
dag_processor_manager_log_location配置正确:
dag_processor_manager_log_location = /opt/airflow/logs/dag_processor_manager/dag_processor_manager.log
- 日志文件实际存在于指定路径,进入worker容器验证:
docker exec -it airflow_airflow-worker_1 bash ls -l /opt/airflow/logs/dag_processor_manager total 18444 -rw-rw-r-- 1 default root 18880639 Oct 10 06:15 dag_processor_manager.log
问题
- 为何DAG Processor状态会显示为Unknown?
- 需要如何配置集群才能让DAG Processor状态正常显示?
内容的提问来源于stack exchange,提问作者jlandercy
相关产品推荐
相关产品推荐

