Cloud Composer调用Dataform仅执行daily标签文件时报错排查

错误原因 #

你遇到的Protocol message WorkflowInvocation has no "invocationConfig" field错误，是因为DataformCreateWorkflowInvocationOperator的参数结构不对——invocationConfig不能嵌套在workflow_invocation字典里，这个字段是Operator的独立参数，而非workflow_invocation的子属性。

修正后的代码 #

把invocationConfig从workflow_invocation中提取出来，作为Operator的单独参数传入即可：

create_workflow_invocation = DataformCreateWorkflowInvocationOperator(
    task_id='create_workflow_invocation',
    project_id=PROJECT_ID,
    region=REGION,
    repository_id=REPOSITORY_ID,
    workflow_invocation={
        "compilation_result": "{{ task_instance.xcom_pull('create_compilation_result')['name'] }}"
    },
    invocation_config={ 
        "includedTags": ["daily"], 
        "transitiveDependenciesIncluded": True 
    },
)

说明 #

• invocation_config参数用于指定执行范围，这里includedTags: ["daily"]会筛选出带有daily标签的sqlx文件
• transitiveDependenciesIncluded: True会自动包含这些文件的依赖项，确保执行流程完整

内容的提问来源于stack exchange，提问作者Gopi Kiran