如何用Python的Selenium获取网站可点击按钮的名称及XPath

核心问题梳理 #

你当前遇到的问题根源：

• 网页动态加载导致元素未就绪就执行查找，返回空结果
• 错误的元素定位策略（指定的supposedly_front_page XPath并未指向可点击元素集合）
• 未处理页面加载的动态等待逻辑

完整解决方案代码 #

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

# 初始化Chrome浏览器
driver = webdriver.Chrome()
driver.get('https://www.cisco.com/')
driver.maximize_window()

# 显式等待并关闭隐私弹窗（避免弹窗遮挡元素）
wait = WebDriverWait(driver, 10)
popup_close_btn = wait.until(EC.element_to_be_clickable((By.XPATH, '//*[@id="onetrust-close-btn-container"]/button')))
popup_close_btn.click()

# 存储可点击元素的文本和XPath
clickable_items = []

# 1. 捕获所有<a>标签（导航链接类可点击元素）
a_elements = wait.until(EC.presence_of_all_elements_located((By.TAG_NAME, 'a')))
for elem in a_elements:
    elem_text = elem.text.strip()
    if elem_text:  # 过滤无文本的空链接
        # 通过JS脚本动态生成元素的XPath
        xpath = driver.execute_script("""
            function getXPath(elem) {
                if (!elem) return '';
                let path = '';
                for (; elem && elem.nodeType === 1; elem = elem.parentNode) {
                    let count = 0;
                    let sibling = elem.previousSibling;
                    while (sibling) {
                        if (sibling.nodeType === 1 && sibling.tagName === elem.tagName) count++;
                        sibling = sibling.previousSibling;
                    }
                    let tagName = elem.tagName.toLowerCase();
                    path = '/' + tagName + (count > 0 ? ('[' + (count + 1) + ']') : '') + path;
                }
                return path;
            }
            return getXPath(arguments[0]);
        """, elem)
        clickable_items.append({"text": elem_text, "xpath": xpath})

# 2. 捕获所有<button>标签（按钮类可点击元素）
button_elements = wait.until(EC.presence_of_all_elements_located((By.TAG_NAME, 'button')))
for elem in button_elements:
    elem_text = elem.text.strip()
    if elem_text:
        xpath = driver.execute_script("""
            function getXPath(elem) {
                if (!elem) return '';
                let path = '';
                for (; elem && elem.nodeType === 1; elem = elem.parentNode) {
                    let count = 0;
                    let sibling = elem.previousSibling;
                    while (sibling) {
                        if (sibling.nodeType === 1 && sibling.tagName === elem.tagName) count++;
                        sibling = sibling.previousSibling;
                    }
                    let tagName = elem.tagName.toLowerCase();
                    path = '/' + tagName + (count > 0 ? ('[' + (count + 1) + ']') : '') + path;
                }
                return path;
            }
            return getXPath(arguments[0]);
        """, elem)
        clickable_items.append({"text": elem_text, "xpath": xpath})

# 按需求生成纯文本列表
clickable_text_list = [item["text"] for item in clickable_items]
print("可点击元素文本列表：")
print(clickable_text_list)

# 若需要查看文本对应的XPath
print("\n可点击元素文本及对应XPath：")
for item in clickable_items:
    print(f"{item['text']} -> {item['xpath']}")

# 关闭浏览器
driver.quit()

关键改进说明 #

• 显式等待：用WebDriverWait确保元素加载完成后再操作，彻底解决动态加载导致的元素找不到问题
• 全面覆盖可点击元素：包含<a>（导航链接）和<button>（按钮）两类最常见的可点击元素，同时过滤无文本的无效元素
• 自动生成XPath：通过JS脚本动态获取元素的XPath，避免手动编写定位表达式的误差
• 单独定位Log in按钮：如果需要单独定位该按钮，可使用wait.until(EC.element_to_be_clickable((By.XPATH, '//a[contains(text(),"Log in")]')))

补充说明 #

如果仍有部分可点击元素未被捕获，可添加对带onclick属性元素的定位：

onclick_elements = wait.until(EC.presence_of_all_elements_located((By.XPATH, '//*[@onclick]')))
# 后续处理逻辑同上述a/button元素

内容的提问来源于stack exchange，提问作者mrin9san