如何在终端/命令行运行HtmlUnit.jar并实现网页元素验证测试

Great question! Let's tackle this step by step—HtmlUnit is absolutely capable of meeting all your web testing needs, and I'll walk you through how to use it via the command line with custom test cases.

Absolutely. HtmlUnit is a headless Java browser that lets you interact with web pages programmatically, which means you can:

• Locate specific elements (anchors, images, scripts, etc.) using CSS selectors or XPath
• Validate element attributes (like href for anchors, src for images/scripts)
• Check element text content
• Even handle JavaScript execution if your pages rely on it (you can disable it too for faster tests)

This covers every requirement you listed.

HtmlUnit isn't distributed as a standalone command-line tool out of the box—it's primarily a Java library. But that doesn't mean you can't use it from the terminal. Here's how to set it up:

Step 1: Prepare HtmlUnit and Dependencies #

First, download the latest HtmlUnit JAR (e.g., htmlunit-2.70.0.jar) along with its required dependencies (like commons-logging, commons-codec, etc.). You can grab these from Maven Central, or use a build tool like Maven/Gradle to manage them automatically.

Step 2: Write a Custom Test Class #

Create a Java class that encapsulates your testing logic, and accepts test cases via command-line arguments. Here's a working example that covers your anchor, image, and script testing needs:

import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlAnchor;
import com.gargoylesoftware.htmlunit.html.HtmlImage;
import com.gargoylesoftware.htmlunit.html.HtmlPage;
import com.gargoylesoftware.htmlunit.html.HtmlScript;

public class WebPageTester {
    public static void main(String[] args) {
        // Validate input arguments
        if (args.length < 3) {
            System.out.println("Usage examples:");
            System.out.println("- Test anchor: java -cp <classpath> WebPageTester <url> \"a#my-link\" <expected-href> <expected-text>");
            System.out.println("- Test image: java -cp <classpath> WebPageTester <url> \"img#hero\" <expected-src>");
            System.out.println("- Test script: java -cp <classpath> WebPageTester <url> \"script#analytics\" <expected-src>");
            System.exit(1);
        }

        String url = args[0];
        String tagSelector = args[1];

        try (WebClient webClient = new WebClient()) {
            // Disable JS/CSS for faster testing (enable if your page needs it)
            webClient.getOptions().setJavaScriptEnabled(false);
            webClient.getOptions().setCssEnabled(false);

            // Load the target page
            HtmlPage page = webClient.getPage(url);
            System.out.println("✅ Loaded page successfully: " + url);

            // Test Anchor Tags
            if (tagSelector.startsWith("a")) {
                if (args.length < 4) {
                    System.err.println("❌ For anchor tests, provide expected href and text");
                    System.exit(1);
                }
                String expectedHref = args[2];
                String expectedText = args[3];

                HtmlAnchor anchor = page.querySelector(tagSelector);
                if (anchor == null) {
                    System.err.println("❌ Anchor tag not found: " + tagSelector);
                    System.exit(1);
                }

                // Validate href
                String actualHref = anchor.getHrefAttribute();
                if (!actualHref.equals(expectedHref)) {
                    System.err.println("❌ Href mismatch! Expected: " + expectedHref + ", Got: " + actualHref);
                    System.exit(1);
                }

                // Validate text content
                String actualText = anchor.asNormalizedText();
                if (!actualText.equals(expectedText)) {
                    System.err.println("❌ Text mismatch! Expected: " + expectedText + ", Got: " + actualText);
                    System.exit(1);
                }

                System.out.println("✅ Anchor tag validation passed!");
            }

            // Test Image Tags
            else if (tagSelector.startsWith("img")) {
                String expectedSrc = args[2];
                HtmlImage img = page.querySelector(tagSelector);
                if (img == null) {
                    System.err.println("❌ Image tag not found: " + tagSelector);
                    System.exit(1);
                }

                String actualSrc = img.getSrcAttribute();
                if (!actualSrc.equals(expectedSrc)) {
                    System.err.println("❌ Src mismatch! Expected: " + expectedSrc + ", Got: " + actualSrc);
                    System.exit(1);
                }

                System.out.println("✅ Image tag validation passed!");
            }

            // Test Script Tags
            else if (tagSelector.startsWith("script")) {
                String expectedSrc = args[2];
                HtmlScript script = page.querySelector(tagSelector);
                if (script == null) {
                    System.err.println("❌ Script tag not found: " + tagSelector);
                    System.exit(1);
                }

                String actualSrc = script.getSrcAttribute();
                if (!actualSrc.isEmpty() && !actualSrc.equals(expectedSrc)) {
                    System.err.println("❌ Script src mismatch! Expected: " + expectedSrc + ", Got: " + actualSrc);
                    System.exit(1);
                }

                System.out.println("✅ Script tag validation passed!");
            }

            // Add more tag types here as needed
            else {
                System.err.println("❌ Unsupported tag type for selector: " + tagSelector);
                System.exit(1);
            }

        } catch (Exception e) {
            System.err.println("❌ Test failed with error: " + e.getMessage());
            e.printStackTrace();
            System.exit(1);
        }
    }
}

Step 3: Compile and Run the Class #

1. Compile the class, making sure to include HtmlUnit and its dependencies in the classpath:

   javac -cp htmlunit-2.70.0.jar:lib/* WebPageTester.java
   

   (If all dependencies are in a lib folder, lib/* will include them all.)

2. Run the class with your test case parameters:

   # Example: Test an anchor tag
   java -cp htmlunit-2.70.0.jar:lib/* WebPageTester https://example.com "a[href='/about']" https://example.com/about "About Us"
   
   # Example: Test an image
   java -cp htmlunit-2.70.0.jar:lib/* WebPageTester https://example.com "img#logo" https://example.com/logo.png
   

As you can see in the example above, we're passing test cases directly via command-line arguments. This lets you reuse the same compiled class for different tests without modifying the code.

If you have multiple test cases to run, you can:

• Write a shell script that loops through a list of test parameters and runs the Java class each time
• Store test cases in a JSON/CSV file, then modify the Java class to read from this file instead of command-line arguments

To avoid typing the long classpath every time, use Maven or Gradle to package your test class and all dependencies into a single executable JAR. For Maven, add this plugin to your pom.xml:

<build>
    <plugins>
        <plugin>
            <artifactId>maven-assembly-plugin</artifactId>
            <version>3.6.0</version>
            <configuration>
                <archive>
                    <manifest>
                        <mainClass>WebPageTester</mainClass>
                    </manifest>
                </archive>
                <descriptorRefs>
                    <descriptorRef>jar-with-dependencies</descriptorRef>
                </descriptorRefs>
            </configuration>
            <executions>
                <execution>
                    <id>make-assembly</id>
                    <phase>package</phase>
                    <goals>
                        <goal>single</goal>
                    </goals>
                </execution>
            </executions>
        </plugin>
    </plugins>
</build>

Then run mvn package, and you'll get a JAR file like WebPageTester-1.0-SNAPSHOT-jar-with-dependencies.jar. Run it with:

java -jar WebPageTester-1.0-SNAPSHOT-jar-with-dependencies.jar <your-test-arguments>

内容的提问来源于stack exchange，提问作者Arun