如何用Python Selenium检测并处理网站上的各类模态窗口？

针对你遇到的类名、结构各异的模态弹窗，可通过结合元素特征的通用JavaScript脚本+Selenium显式等待来处理，以下是具体实现思路：

一、编写通用弹窗检测与关闭的JS脚本 #

模态弹窗和遮罩层有共性特征：定位多为fixed/absolute、z-index数值极高、通常包含带“关闭”“X”“取消”“跳过”等关键词的按钮。基于这些特征写通用函数：

function closeModalPopups() {
    // 匹配常见的模态弹窗、遮罩层选择器
    const popupSelectors = [
        '[class*="modal"], [class*="popup"], [class*="dialog"], [class*="overlay"]',
        '[id*="modal"], [id*="popup"], [id*="dialog"], [id*="overlay"]',
        'div[style*="position: fixed"], div[style*="position: absolute"]'
    ].join(', ');
    
    const popups = document.querySelectorAll(popupSelectors);
    let hasClosed = false;
    const closeTexts = ['关闭', 'X', 'Cancel', '取消', '跳过', 'Skip', '拒绝', 'Dismiss'];

    popups.forEach(popup => {
        // 过滤非顶层元素（z-index低于1000的大概率不是弹窗）
        const zIndex = window.getComputedStyle(popup).zIndex;
        if (zIndex && parseInt(zIndex) < 1000) return;
        
        // 查找弹窗内的关闭按钮
        const allElements = popup.querySelectorAll('button, a, span');
        const closeButtons = Array.from(allElements).filter(el => 
            closeTexts.some(text => el.textContent.trim().includes(text))
        );
        
        if (closeButtons.length > 0) {
            closeButtons[0].click();
            hasClosed = true;
        } else {
            // 无关闭按钮时直接移除弹窗
            popup.remove();
            hasClosed = true;
        }
    });
    return hasClosed;
}

closeModalPopups();

二、在Selenium中结合显式等待调用脚本 #

弹窗可能延迟加载，用WebDriverWait循环执行关闭脚本，覆盖延迟出现的情况：

from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait

driver = webdriver.Chrome()
driver.get("目标网站URL")

# 最多等待5秒，尝试关闭弹窗
try:
    WebDriverWait(driver, 5).until(
        lambda d: d.execute_script("""
            function closeModalPopups() {
                const popupSelectors = [
                    '[class*="modal"], [class*="popup"], [class*="dialog"], [class*="overlay"]',
                    '[id*="modal"], [id*="popup"], [id*="dialog"], [id*="overlay"]',
                    'div[style*="position: fixed"], div[style*="position: absolute"]'
                ].join(', ');
                const popups = document.querySelectorAll(popupSelectors);
                let hasClosed = false;
                const closeTexts = ['关闭', 'X', 'Cancel', '取消', '跳过', 'Skip', '拒绝', 'Dismiss'];

                popups.forEach(popup => {
                    const zIndex = window.getComputedStyle(popup).zIndex;
                    if (zIndex && parseInt(zIndex) < 1000) return;
                    
                    const allElements = popup.querySelectorAll('button, a, span');
                    const closeButtons = Array.from(allElements).filter(el => 
                        closeTexts.some(text => el.textContent.trim().includes(text))
                    );
                    
                    if (closeButtons.length > 0) {
                        closeButtons[0].click();
                        hasClosed = true;
                    } else {
                        popup.remove();
                        hasClosed = true;
                    }
                });
                return hasClosed;
            }
            return closeModalPopups();
        """)
    )
except:
    # 无弹窗或关闭失败，不影响后续截图
    pass

# 执行首屏截图
driver.save_screenshot("首屏截图.png")
driver.quit()

三、额外优化建议 #

• 将JS脚本存为单独文件，用driver.execute_script(open("close_popups.js").read())调用，更易维护
• 针对部分弹窗，可模拟ESC按键关闭：driver.execute_script("document.dispatchEvent(new KeyboardEvent('keydown', {key: 'Escape'}));")
• 若弹窗在iframe内，需先切换到iframe再执行关闭脚本

内容的提问来源于stack exchange，提问作者Yatupic