You need to enable JavaScript to run this app. Java Selenium如何将失败测试数据传递给soft assert定位错误用例
优惠活动
大模型
产品
解决方案
定价
更多

Java Selenium如何将失败测试数据传递给soft assert定位错误用例

问题场景

测试数据结构

测试数据存储在JSON文件中,结构如下:

{
    "alerts" : [
    {
        "alert_name" : "employee",
        "sql_query" : "select * from employee",
        "description" : "Query with Variables",
        "default_interval" : "10 minutes",
        "default_priority" : "Critical",
        "variables" : [{
                            "variable" : "failurereason",
                            "value" : "INVALID USER"
                            },
                            {
                            "variable" : "count",
                            "value" : "1"
                    }]
        },
    {
        "alert_name" : "employee2",
        "sql_query" : "select * from employee2",
        "description" : "Query with Variables",
        "default_interval" : "10 minutes",
        "default_priority" : "Critical",
        "variables" : [{
                            "variable" : "failurereason",
                            "value" : "INVALID USER"
                            },
                            {
                            "variable" : "count",
                            "value" : "1"
                    }]
        }
    ]
}

原有测试方法实现

Java Selenium测试方法遍历JSON数据与实际数据校验,代码如下:

public boolean createAlert(String jsonFile,String Host, String Port) {
        boolean success = true;
        String logStr = "Unable to create Alert";
        
        JSONObject readJsonFilePath = rjf.readJsonFilePath(jsonFile);
        JSONArray alertsJsonArray = readJsonFilePath.getJSONArray("alerts");
        
        System.out.println("+++++ Number of Test Cases to be run are : " + alertsJsonArray.length() + " +++++");
        
        for(int i = 0; i < alertsJsonArray.length(); i++)
        {
            JSONObject alertJsonObject = alertsJsonArray.getJSONObject(i);
            String description = alertJsonObject.getString("description");
            System.out.println("+++++++++++Test Case : " + i + " Running : " + description + " ++++++++++++++");
            
            String alert_name = alertJsonObject.getString("alert_name");
            String sql_query = alertJsonObject.getString("sql_query");
            String defaultInterval = alertJsonObject.getString("default_interval");
            String defaultPriority = alertJsonObject.getString("default_priority");
            
            if (
                    this.clickUponCreate(alert_name,sql_query) &&
                    this.setVariablesInVariableBar(alertJsonObject,"variables") &&
                    this.runQueryCreateAlertAndVerifyIsAlertCreated(alert_name, Host, Port, defaultInterval, defaultPriority))
            {   
                logStr = "Able to set the values ";
            }
            else {
                System.out.println(TEXT_RED +  alert_name + description + "Test Case : " + i + " Failed");
                success=false;
            }
          }
        System.out.println(logStr);
        return success;
    }

现有校验痛点

当前使用软断言的校验方式为:

softassert.assertTrue(page.createAlert(jsonFile,Host,Port),
                "test11.1: Verified combinations of Alerts");

仅能得到整体执行是否成功的布尔结果,无法定位JSON数组中具体哪条测试数据失败,当用例数量较多时排查效率极低。


可行实现方案
  • 方案1:修改方法返回值,返回失败用例明细列表
    把原方法的返回值从boolean改为List<String>,存储所有失败用例的标识(索引+告警名称+描述),如果列表为空代表全部成功。
    代码示例:
// 修改后的createAlert方法
public List<String> createAlert(String jsonFile,String Host, String Port) {
        List<String> failedCases = new ArrayList<>();
        
        JSONObject readJsonFilePath = rjf.readJsonFilePath(jsonFile);
        JSONArray alertsJsonArray = readJsonFilePath.getJSONArray("alerts");
        
        System.out.println("+++++ 待执行用例总数 : " + alertsJsonArray.length() + " +++++");
        
        for(int i = 0; i < alertsJsonArray.length(); i++)
        {
            JSONObject alertJsonObject = alertsJsonArray.getJSONObject(i);
            String description = alertJsonObject.getString("description");
            String alert_name = alertJsonObject.getString("alert_name");
            System.out.println("+++++++++++执行用例 : " + i + " 描述 : " + description + " ++++++++++++++");
            
            String sql_query = alertJsonObject.getString("sql_query");
            String defaultInterval = alertJsonObject.getString("default_interval");
            String defaultPriority = alertJsonObject.getString("default_priority");
            
            boolean caseResult = this.clickUponCreate(alert_name,sql_query) &&
                    this.setVariablesInVariableBar(alertJsonObject,"variables") &&
                    this.runQueryCreateAlertAndVerifyIsAlertCreated(alert_name, Host, Port, defaultInterval, defaultPriority);
            if (!caseResult) {
                String failInfo = String.format("用例索引:%d, 告警名称:%s, 描述:%s 执行失败", i, alert_name, description);
                System.out.println(TEXT_RED + failInfo);
                failedCases.add(failInfo);
            }
          }
        if (failedCases.isEmpty()) {
            System.out.println("所有用例执行成功");
        } else {
            System.out.println("失败用例数量:" + failedCases.size());
        }
        return failedCases;
    }

// 调用时的软断言写法
List<String> failedCases = page.createAlert(jsonFile,Host,Port);
softassert.assertTrue(failedCases.isEmpty(), "test11.1 存在失败用例:\n" + String.join("\n", failedCases));
  • 方案2:将软断言传入方法内部,逐用例校验
    把SoftAssert对象作为参数传入createAlert方法,每执行完一条用例就直接做断言,自动携带上下文定位信息。
    代码示例:
// 修改后的createAlert方法
public void createAlert(String jsonFile,String Host, String Port, SoftAssert softAssert) {
        JSONObject readJsonFilePath = rjf.readJsonFilePath(jsonFile);
        JSONArray alertsJsonArray = readJsonFilePath.getJSONArray("alerts");
        
        System.out.println("+++++ 待执行用例总数 : " + alertsJsonArray.length() + " +++++");
        
        for(int i = 0; i < alertsJsonArray.length(); i++)
        {
            JSONObject alertJsonObject = alertsJsonArray.getJSONObject(i);
            String description = alertJsonObject.getString("description");
            String alert_name = alertJsonObject.getString("alert_name");
            System.out.println("+++++++++++执行用例 : " + i + " 描述 : " + description + " ++++++++++++++");
            
            String sql_query = alertJsonObject.getString("sql_query");
            String defaultInterval = alertJsonObject.getString("default_interval");
            String defaultPriority = alertJsonObject.getString("default_priority");
            
            boolean caseResult = this.clickUponCreate(alert_name,sql_query) &&
                    this.setVariablesInVariableBar(alertJsonObject,"variables") &&
                    this.runQueryCreateAlertAndVerifyIsAlertCreated(alert_name, Host, Port, defaultInterval, defaultPriority);
            // 单条用例直接断言,自带定位信息
            softAssert.assertTrue(caseResult, String.format("test11.1 用例索引:%d, 告警名称:%s, 描述:%s 执行失败", i, alert_name, description));
          }
    }

// 调用方式
page.createAlert(jsonFile,Host,Port,softassert);
  • 方案3:补充日志链路标识,配合日志定位
    如果不想修改原有方法返回结构,可以在每条用例执行时输出唯一标识(比如用例索引+告警名称)到日志文件,测试失败后直接检索日志即可定位失败用例。

内容的提问来源于stack exchange,提问作者Ashu123

相关产品推荐
方舟 Agent Plan

超全模态模型 × Harness 升级,最新支持 Deepseek-V4.1-Flash、GLM-5.3 系列、Doubao-Seedream-5.0-pro、Kimi-K3 (部分), 限时 9.9 元起

最近更新时间:2026.10.12 15:03:02