Apache Airflow DAG导入langchain_openai等库报错求助

问题描述 #

在名为llm_workflow_dag.py的Apache Airflow DAG中，尝试使用langchain_openai库的AzureOpenAI组件时，Airflow UI提示Broken DAG错误，具体表现为找不到langchain_openai模块。

报错信息 #

ModuleNotFoundError: No module named 'langchain_openai'

已尝试操作 #

• 通过项目根目录的requirements.txt安装langchain_openai依赖
• 进入webserver容器执行pip安装命令，系统提示该依赖已满足

相关配置（docker-compose.yml） #

以下是airflow-webserver和airflow-init服务的配置：

airflow-webserver:
    image: apache/airflow:2.10.2
    container_name: airflow-webserver
    restart: always
    depends_on:
      - postgres
      - airflow-scheduler
    environment:
      - AIRFLOW__CORE__EXECUTOR=LocalExecutor
      - AIRFLOW__CORE__SQL_ALCHEMY_CONN=postgresql+psycopg2://airflow:airflow@postgres:5432/airflow
      - AIRFLOW__CORE__LOAD_EXAMPLES=False
      - _AIRFLOW_WWW_USER_USERNAME=admin        
      - _AIRFLOW_WWW_USER_PASSWORD=admin        
      # - PYTHONPATH=/opt/airflow/modules  # Add this line to set PYTHONPATH

    volumes:
      - ./dags:/opt/airflow/dags
      - ./logs:/opt/airflow/logs
      - ./modules:/opt/airflow/modules  # Mapping the modules folder
      - ./airflow.cfg:/opt/airflow/airflow.cfg  
      - ./requirements.txt:/requirements.txt  
      - "C:/Users/navthars/Desktop/PENV/.venv:/usr/local/airflow/.venv"  
      # - ./modules:/opt/airflow/modules  # Correct volume mapping for modules

    ports:
      - "8080:8080"
    command: >
      bash -c "pip install -r /requirements.txt && airflow webserver"
  airflow-init:
    image: apache/airflow:2.10.2
    container_name: airflow-init
    depends_on:
      - postgres
    environment:
      - AIRFLOW__CORE__EXECUTOR=LocalExecutor
      - AIRFLOW__CORE__SQL_ALCHEMY_CONN=postgresql+psycopg2://airflow:airflow@postgres:5432/airflow
    volumes:
      - ./dags:/opt/airflow/dags
      - ./logs:/opt/airflow/logs
      # - ./modules:/opt/airflow/modules  # Mapping the modules folderd
    entrypoint: >
      /bin/bash -c
      "airflow db init"
    command: "echo Initializing Airflow Database"

文件夹结构 #

项目根目录下包含以下文件及文件夹：

• dags/
• logs/
• modules/
• airflow.cfg
• requirements.txt
• docker-compose.yml

内容的提问来源于stack exchange，提问作者JohnB