Azure Pipeline中Playwright测试集成Allure报告遇阻求助

核心问题 #

1. 重复执行测试：流水线中先后执行了npm run regression和npx playwright test --reporter=line,allure-playwright，两次测试生成的结果可能互相干扰，且造成资源冗余。
2. 缺少Allure核心依赖：package.json中仅安装了Playwright适配的allure-playwright，但未安装生成报告必需的allure-commandline工具，导致报告生成命令可能无法正常执行甚至卡住。
3. CI环境不支持图形化操作：allure open是本地打开浏览器的命令，CI代理为无头环境，若误触发该命令会直接卡住流程。

具体修复步骤 #

1. 更新package.json配置 #

添加Allure命令行依赖，并优化测试脚本避免重复执行：

{
  "name": "playwright",
  "version": "1.0.0",
  "description": "",
  "main": "index.js",
  "scripts": {
    "regression": "npx playwright test --reporter=line,allure-playwright",
    "gen-report": "npx allure generate ./allure-results --clean -o ./allure-report",
    "open-report": "allure open ./allure-report"
  },
  "keywords": [],
  "author": "",
  "license": "ISC",
  "devDependencies": {
    "@playwright/test": "^1.43.1",
    "@types/node": "^20.7.1",
    "@zerostep/playwright": "^0.1.5",
    "allure-playwright": "^2.15.1",
    "allure-commandline": "^2.25.0"
  },
  "dependencies": {
    "@cucumber/cucumber": "^10.4.0"
  }
}

2. 修正Azure Pipeline YAML配置 #

移除重复测试步骤，统一执行带Allure报告器的测试，并明确报告生成逻辑：

trigger:
- none

pool: customagent

steps:
- task: NodeTool@0
  inputs:
    versionSpec: '18'
  displayName: 'Install Node.js'

- script: npm ci
  displayName: 'Install dependencies'

- script: npx playwright install --with-deps
  displayName: 'Install Playwright browsers'

- script: npm run regression
  displayName: 'Run Playwright tests with Allure reporter'
  env:
    CI: 'true'

- script: npm run gen-report
  displayName: 'Generate Allure static report'

- task: qameta.allure-azure-pipelines.PublishAllureReport.PublishAllureReport@1
  inputs:
    testResultsDir: 'allure-results'
    reportName: 'Playwright Allure Test Report'
  displayName: 'Publish Allure Report to Azure Pipelines'

3. 验证自定义代理环境 #

确保你的customagent满足以下要求：

• 已安装Java 8及以上版本（Allure命令行工具依赖Java）
• 拥有工作目录下allure-results和allure-report文件夹的读写权限

关键注意事项 #

• 绝对不要在CI流水线中执行allure open命令，该命令仅用于本地调试查看报告
• allure generate命令添加-o ./allure-report参数明确指定报告输出目录，避免路径歧义
• 保持allure-commandline与allure-playwright版本兼容，版本差异可能导致报告生成失败

内容的提问来源于stack exchange，提问作者Amar