Azure DevOps YAML部署流水线无法引用阶段内变量组

问题概述 #

搭建Azure Data Factory（ADF）构建与部署流水线时，构建环节正常，但使用次级YAML模板实现多环境部署时，阶段级别引用变量组的变量无法被识别。单独为各环境定义变量时一切正常，但引用变量组会报“变量未找到”错误，尝试过$()、${{}}、$[]等语法均无效。已确认流水线有权限访问变量组，且变量组与流水线在同一项目中。

原错误流水线代码 #

trigger:
  branches:
    include:
      - main
  paths:
    exclude:
      - CICD/*

pool:
  vmImage: ubuntu-latest

variables:
  - group: VG-DWH-GEN
  - name: BuildAdfResourceId
    value: /subscriptions/$(subscriptionID)/resourceGroups/$(ResourceGroupNamePrefix)$(environmentID)/providers/Microsoft.DataFactory/factories/$(ADFNamePrefix)$(environmentID)-01
  - name: WorkspaceArmTemplateDirectory
    value: $(Pipeline.Workspace)/adf-artifact-ArmTemplate

stages:
- stage: Deploy_Dev_Stage
  displayName: Deploy Dev stage
  dependsOn: Build_ADF_ARM_Stage
  condition: succeeded('Build_ADF_ARM_Stage')

  variables:
  - group: VG-DWH-DEV

  jobs:
  - template: ADF_Deployment.yml
    parameters: 
      azureSubscription: $(ServiceConnectionPrefix)$(variables.environmentID)-development
      environment: $(variables.environment)
      resourceGroupName: '$(ResourceGroupNamePrefix)$(variables.environmentID)'
      dataFactoryName: '$(ADFNamePrefix)$(environmentID)-01'

次级模板代码（ADF_Deployment.yml） #

parameters: 
  - name: azureSubscription
    type: string
  - name: environment
    type: string
  - name: resourceGroupName
    type: string
  - name: dataFactoryName
    type: string

jobs:
  - deployment: 'deployment_job_${{ parameters.environment }}'
    displayName: 'Deployment Job ${{ parameters.environment }}'
    environment: 'Deploy ADF to ${{ parameters.environment }}'
    variables:
      - group: 'VG-DWH-${{ upper(parameters.environment) }}'
    strategy:
      runOnce:
        deploy:
          steps:
            - task: DownloadPipelineArtifact@2
              displayName: Download Build Artifacts - ADF ARM Templates
              inputs:
                artifactName: 'adf-artifact-ArmTemplate'
                targetPath: $(WorkspaceArmTemplateDirectory)
            - script: dir
              displayName: List files in Workspace
              workingDirectory: '$(WorkspaceArmTemplateDirectory)'

            - task: AzurePowerShell@5 
              displayName: 'Azure PowerShell script: Pre-deployment' 
              inputs: 
                azureSubscription: '${{ parameters.azureSubscription }}'
                ScriptPath: '$(WorkspaceArmTemplateDirectory)/PrePostDeploymentScript.ps1'
                ScriptArguments: '-armTemplate ''$(WorkspaceArmTemplateDirectory)/ARMTemplateForFactory.json'' -ResourceGroupName ${{ parameters.resourceGroupName }} -DataFactoryName ${{ parameters.dataFactoryName }} -predeployment $true -deleteDeployment $false' 
                azurePowerShellVersion: LatestVersion

            - task: AzureResourceManagerTemplateDeployment@3 
              displayName: 'ARM Template deployment: Data Factory' 
              inputs:
                azureResourceManagerConnection: '${{ parameters.azureSubscription }}'
                subscriptionId: '$(subscriptionID)'
                resourceGroupName: '${{ parameters.resourceGroupName }}' 
                location: 'West Europe' 
                csmFile: '$(WorkspaceArmTemplateDirectory)/ARMTemplateForFactory.json' 
                csmParametersFile: '$(WorkspaceArmTemplateDirectory)/ARMTemplateParametersForFactory.json' 
                overrideParameters: >
                  -factoryName "${{ parameters.dataFactoryName }}"
                  -LS_ADLS_Dataplatform_properties_typeProperties_url "https://$(StorageAccount).dfs.core.windows.net/"
                  -LS_ASQLDB_Dataplatform_properties_typeProperties_server "$(ServerName)"
                  -LS_REST_AFAS_properties_typeProperties_url "$(AFASRestAPIURL)"
                  -LS_KV_Dataplatform_properties_typeProperties_baseUrl "$(keyVaultURL)"
                deploymentMode: 'Incremental'
 
            - task: AzurePowerShell@5 
              displayName: 'Azure PowerShell script: Post-deployment' 
              inputs: 
                azureSubscription: '${{ parameters.azureSubscription }}'
                ScriptPath: '$(WorkspaceArmTemplateDirectory)/PrePostDeploymentScript.ps1'
                ScriptArguments: '-armTemplate ''$(WorkspaceArmTemplateDirectory)/ARMTemplateForFactory.json'' -ResourceGroupName ${{ parameters.resourceGroupName }} -DataFactoryName ${{ parameters.dataFactoryName }} -predeployment $false -deleteDeployment $true' 
                azurePowerShellVersion: LatestVersion

问题原因与解决方案 #

1. 变量作用域与解析语法问题 #

阶段级变量组的变量无需添加variables.前缀，直接使用$(变量名)即可。你在传递模板参数时使用$(variables.environmentID)属于冗余写法，会导致解析失败。

2. 重复变量组引用冲突 #

次级模板已通过参数动态加载环境变量组VG-DWH-${{ upper(parameters.environment) }}，阶段级重复引用VG-DWH-DEV会造成变量作用域混乱，建议移除阶段级的重复引用，保留模板内的动态加载逻辑。

3. 修正参数传递逻辑 #

传递模板参数时，确保变量来自正确的作用域：全局通用变量（如ServiceConnectionPrefix）从流水线级变量组VG-DWH-GEN获取，环境标识直接传入或从全局变量读取。

修正后的流水线代码 #

trigger:
  branches:
    include:
      - main
  paths:
    exclude:
      - CICD/*

pool:
  vmImage: ubuntu-latest

variables:
  - group: VG-DWH-GEN
  - name: BuildAdfResourceId
    value: /subscriptions/$(subscriptionID)/resourceGroups/$(ResourceGroupNamePrefix)$(environmentID)/providers/Microsoft.DataFactory/factories/$(ADFNamePrefix)$(environmentID)-01
  - name: WorkspaceArmTemplateDirectory
    value: $(Pipeline.Workspace)/adf-artifact-ArmTemplate

stages:
- stage: Deploy_Dev_Stage
  displayName: Deploy Dev stage
  dependsOn: Build_ADF_ARM_Stage
  condition: succeeded('Build_ADF_ARM_Stage')

  jobs:
  - template: ADF_Deployment.yml
    parameters: 
      azureSubscription: $(ServiceConnectionPrefix)$(environmentID)-development
      environment: dev # 直接指定环境标识，或用全局变量$(environment)（需确保VG-DWH-GEN中存在该变量）
      resourceGroupName: '$(ResourceGroupNamePrefix)$(environmentID)'
      dataFactoryName: '$(ADFNamePrefix)$(environmentID)-01'

额外注意事项 #

• 确认VG-DWH-GEN变量组包含environmentID、ServiceConnectionPrefix等全局通用变量。
• 确保各环境变量组命名规则一致（如VG-DWH-DEV、VG-DWH-UAT），匹配模板中VG-DWH-${{ upper(parameters.environment) }}的动态加载逻辑。
• ARM模板部署的overrideParameters中，$(StorageAccount)等变量需存在于对应环境的变量组中。

内容的提问来源于stack exchange，提问作者Koen van Wielink