使用lxml etree的getpath获取Google搜索按钮绝对XPath结果异常

你遇到的绝对XPath结果异常，核心是用XML解析器处理HTML文档导致DOM结构被破坏。HTML属于松散结构的标记语言，并非严格的XML，etree.XMLParser会错误解析HTML中的非标准语法（比如script标签内容、未闭合标签），导致<body>被错误嵌套到<script>/<br>节点下，最终生成的绝对XPath完全偏离真实DOM层级。

方法1：改用lxml的HTML专用解析器 #

替换XMLParser为HTMLParser，它专门针对HTML的松散结构设计，能正确还原页面DOM层级：

import time
from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from webdriver_manager.chrome import ChromeDriverManager
from lxml import etree

options = webdriver.ChromeOptions()
options.add_argument("start-maximized")
options.add_argument("--log-level=3")
options.add_experimental_option("excludeSwitches", ["enable-automation"])
options.add_experimental_option('useAutomationExtension', False)
options.add_argument('--disable-blink-features=AutomationControlled')
s = Service(ChromeDriverManager().install())
driver = webdriver.Chrome(service=s, options=options)

main_link = "https://www.google.com"
driver.get(main_link)

time.sleep(5)

# 直接用HTML解析器处理页面源码，无需存文件
tree = etree.HTML(driver.page_source)
element = tree.xpath("(//input[@class='gNO89b'])[2]")
print(tree.getpath(element[0]))

driver.quit()

方法2：直接通过Selenium获取绝对XPath #

跳过lxml解析步骤，用Selenium自带的JS执行能力直接获取元素的绝对XPath，避免解析差异：

import time
from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.common.by import By
from webdriver_manager.chrome import ChromeDriverManager

options = webdriver.ChromeOptions()
options.add_argument("start-maximized")
options.add_argument("--log-level=3")
options.add_experimental_option("excludeSwitches", ["enable-automation"])
options.add_experimental_option('useAutomationExtension', False)
options.add_argument('--disable-blink-features=AutomationControlled')
s = Service(ChromeDriverManager().install())
driver = webdriver.Chrome(service=s, options=options)

main_link = "https://www.google.com"
driver.get(main_link)

time.sleep(5)

# 定位目标元素
element = driver.find_element(By.XPATH, "(//input[@class='gNO89b'])[2]")
# 执行JS脚本生成绝对XPath
absolute_xpath = driver.execute_script("""
function getAbsoluteXPath(el) {
    let path = [];
    while (el && el.nodeType === Node.ELEMENT_NODE) {
        let siblingCount = 0;
        let sibling = el.previousSibling;
        while (sibling) {
            if (sibling.nodeType === Node.ELEMENT_NODE && sibling.tagName === el.tagName) {
                siblingCount++;
            }
            sibling = sibling.previousSibling;
        }
        let tag = el.tagName.toLowerCase();
        path.unshift(tag + (siblingCount > 0 ? `[${siblingCount + 1}]` : ''));
        el = el.parentNode;
    }
    return '/' + path.join('/');
}
return getAbsoluteXPath(arguments[0]);
""", element)

print(absolute_xpath)

driver.quit()

• Google页面的元素类名（如gNO89b）可能随版本更新变化，更稳定的定位方式可改用//input[@value='Google 搜索']或结合name属性的XPath。
• 避免使用固定时长的time.sleep()，推荐用WebDriverWait显式等待元素加载，提升代码稳定性：

  from selenium.webdriver.support.ui import WebDriverWait
  from selenium.webdriver.support import expected_conditions as EC
  
  # 等待元素出现，最长等待10秒
  element = WebDriverWait(driver, 10).until(
      EC.presence_of_element_located((By.XPATH, "(//input[@class='gNO89b'])[2]"))
  )
  

内容的提问来源于stack exchange，提问作者fardV