Java Selenium如何将失败测试数据传递给soft assert定位错误用例
问题场景
测试数据结构
测试数据存储在JSON文件中,结构如下:
{ "alerts" : [ { "alert_name" : "employee", "sql_query" : "select * from employee", "description" : "Query with Variables", "default_interval" : "10 minutes", "default_priority" : "Critical", "variables" : [{ "variable" : "failurereason", "value" : "INVALID USER" }, { "variable" : "count", "value" : "1" }] }, { "alert_name" : "employee2", "sql_query" : "select * from employee2", "description" : "Query with Variables", "default_interval" : "10 minutes", "default_priority" : "Critical", "variables" : [{ "variable" : "failurereason", "value" : "INVALID USER" }, { "variable" : "count", "value" : "1" }] } ] }
原有测试方法实现
Java Selenium测试方法遍历JSON数据与实际数据校验,代码如下:
public boolean createAlert(String jsonFile,String Host, String Port) { boolean success = true; String logStr = "Unable to create Alert"; JSONObject readJsonFilePath = rjf.readJsonFilePath(jsonFile); JSONArray alertsJsonArray = readJsonFilePath.getJSONArray("alerts"); System.out.println("+++++ Number of Test Cases to be run are : " + alertsJsonArray.length() + " +++++"); for(int i = 0; i < alertsJsonArray.length(); i++) { JSONObject alertJsonObject = alertsJsonArray.getJSONObject(i); String description = alertJsonObject.getString("description"); System.out.println("+++++++++++Test Case : " + i + " Running : " + description + " ++++++++++++++"); String alert_name = alertJsonObject.getString("alert_name"); String sql_query = alertJsonObject.getString("sql_query"); String defaultInterval = alertJsonObject.getString("default_interval"); String defaultPriority = alertJsonObject.getString("default_priority"); if ( this.clickUponCreate(alert_name,sql_query) && this.setVariablesInVariableBar(alertJsonObject,"variables") && this.runQueryCreateAlertAndVerifyIsAlertCreated(alert_name, Host, Port, defaultInterval, defaultPriority)) { logStr = "Able to set the values "; } else { System.out.println(TEXT_RED + alert_name + description + "Test Case : " + i + " Failed"); success=false; } } System.out.println(logStr); return success; }
现有校验痛点
当前使用软断言的校验方式为:
softassert.assertTrue(page.createAlert(jsonFile,Host,Port), "test11.1: Verified combinations of Alerts");
仅能得到整体执行是否成功的布尔结果,无法定位JSON数组中具体哪条测试数据失败,当用例数量较多时排查效率极低。
可行实现方案
- 方案1:修改方法返回值,返回失败用例明细列表
把原方法的返回值从boolean改为List<String>,存储所有失败用例的标识(索引+告警名称+描述),如果列表为空代表全部成功。
代码示例:
// 修改后的createAlert方法 public List<String> createAlert(String jsonFile,String Host, String Port) { List<String> failedCases = new ArrayList<>(); JSONObject readJsonFilePath = rjf.readJsonFilePath(jsonFile); JSONArray alertsJsonArray = readJsonFilePath.getJSONArray("alerts"); System.out.println("+++++ 待执行用例总数 : " + alertsJsonArray.length() + " +++++"); for(int i = 0; i < alertsJsonArray.length(); i++) { JSONObject alertJsonObject = alertsJsonArray.getJSONObject(i); String description = alertJsonObject.getString("description"); String alert_name = alertJsonObject.getString("alert_name"); System.out.println("+++++++++++执行用例 : " + i + " 描述 : " + description + " ++++++++++++++"); String sql_query = alertJsonObject.getString("sql_query"); String defaultInterval = alertJsonObject.getString("default_interval"); String defaultPriority = alertJsonObject.getString("default_priority"); boolean caseResult = this.clickUponCreate(alert_name,sql_query) && this.setVariablesInVariableBar(alertJsonObject,"variables") && this.runQueryCreateAlertAndVerifyIsAlertCreated(alert_name, Host, Port, defaultInterval, defaultPriority); if (!caseResult) { String failInfo = String.format("用例索引:%d, 告警名称:%s, 描述:%s 执行失败", i, alert_name, description); System.out.println(TEXT_RED + failInfo); failedCases.add(failInfo); } } if (failedCases.isEmpty()) { System.out.println("所有用例执行成功"); } else { System.out.println("失败用例数量:" + failedCases.size()); } return failedCases; } // 调用时的软断言写法 List<String> failedCases = page.createAlert(jsonFile,Host,Port); softassert.assertTrue(failedCases.isEmpty(), "test11.1 存在失败用例:\n" + String.join("\n", failedCases));
- 方案2:将软断言传入方法内部,逐用例校验
把SoftAssert对象作为参数传入createAlert方法,每执行完一条用例就直接做断言,自动携带上下文定位信息。
代码示例:
// 修改后的createAlert方法 public void createAlert(String jsonFile,String Host, String Port, SoftAssert softAssert) { JSONObject readJsonFilePath = rjf.readJsonFilePath(jsonFile); JSONArray alertsJsonArray = readJsonFilePath.getJSONArray("alerts"); System.out.println("+++++ 待执行用例总数 : " + alertsJsonArray.length() + " +++++"); for(int i = 0; i < alertsJsonArray.length(); i++) { JSONObject alertJsonObject = alertsJsonArray.getJSONObject(i); String description = alertJsonObject.getString("description"); String alert_name = alertJsonObject.getString("alert_name"); System.out.println("+++++++++++执行用例 : " + i + " 描述 : " + description + " ++++++++++++++"); String sql_query = alertJsonObject.getString("sql_query"); String defaultInterval = alertJsonObject.getString("default_interval"); String defaultPriority = alertJsonObject.getString("default_priority"); boolean caseResult = this.clickUponCreate(alert_name,sql_query) && this.setVariablesInVariableBar(alertJsonObject,"variables") && this.runQueryCreateAlertAndVerifyIsAlertCreated(alert_name, Host, Port, defaultInterval, defaultPriority); // 单条用例直接断言,自带定位信息 softAssert.assertTrue(caseResult, String.format("test11.1 用例索引:%d, 告警名称:%s, 描述:%s 执行失败", i, alert_name, description)); } } // 调用方式 page.createAlert(jsonFile,Host,Port,softassert);
- 方案3:补充日志链路标识,配合日志定位
如果不想修改原有方法返回结构,可以在每条用例执行时输出唯一标识(比如用例索引+告警名称)到日志文件,测试失败后直接检索日志即可定位失败用例。
内容的提问来源于stack exchange,提问作者Ashu123
相关产品推荐
相关产品推荐

