本地Ubuntu环境中Apache Airflow无法加载CeleryExecutor的问题求助
大家好,我在Ubuntu本地环境安装了Apache Airflow,但启动调度器的时候遇到了Executor加载失败的问题,以下是完整的报错回溯信息:
[2022-12-20 22:11:13,927] {manager.py:343} WARNING - Ending without manager process.
[2022-12-20 22:11:13,928] {scheduler_job.py:788} INFO - Exited execute loop
Traceback (most recent call last):
File "/usr/local/bin/airflow", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.8/dist-packages/airflow/main.py", line 39, in main
args.func(args)
File "/usr/local/lib/python3.8/dist-packages/airflow/cli/cli_parser.py", line 52, in command
return func(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/airflow/utils/cli.py", line 108, in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/airflow/cli/commands/scheduler_command.py", line 73, in scheduler
_run_scheduler_job(args=args)
File "/usr/local/lib/python3.8/dist-packages/airflow/cli/commands/scheduler_command.py", line 43, in _run_scheduler_job
job.run()
File "/usr/local/lib/python3.8/dist-packages/airflow/jobs/base_job.py", line 247, in run
self._execute()
File "/usr/local/lib/python3.8/dist-packages/airflow/jobs/scheduler_job.py", line 738, in _execute
self.executor.job_id = self.id
File "/usr/lib/python3.8/functools.py", line 967, in get
val = self.func(instance)
File "/usr/local/lib/python3.8/dist-packages/airflow/jobs/base_job.py", line 119, in executor
return ExecutorLoader.get_default_executor()
File "/usr/local/lib/python3.8/dist-packages/airflow/executors/executor_loader.py", line 77, in get_default_executor
cls._default_executor = cls.load_executor(executor_name)
File "/usr/local/lib/python3.8/dist-packages/airflow/executors/executor_loader.py", line 103, in load_executor
raise AirflowConfigException(
airflow.exceptions.AirflowConfigException: The module/attribute could not be loaded. Please check "executor" key in "core" section. Current value: "CeleryExecutor".
我的airflow.cfg配置文件中关于Executor的部分配置如下:
# The executor class that airflow should use. Choices include # ``SequentialExecutor``, ``LocalExecutor``, ``CeleryExecutor``, ``DaskExecutor``, # ``KubernetesExecutor``, ``CeleryKubernetesExecutor`` or the # full import path to the class when using a custom executor. executor = CeleryExecutor
有没有懂的朋友帮忙分析下问题出在哪,该怎么解决呢?
备注:内容来源于stack exchange,提问作者dipretelin

