Selenium中WebDriverWait+element_to_be_clickable失效问题求助

使用Selenium实现翻页功能时，即便通过显式等待判断元素可点击，仍抛出element not clickable exception异常。添加time.sleep(1)能临时解决问题，但多页场景下既不可靠也低效，希望找到能等待元素可点击后立即点击的方案。

初始化Driver代码 #

from selenium import webdriver 
from selenium.webdriver import Chrome 
from selenium.webdriver.chrome.service import Service 
from webdriver_manager.chrome import ChromeDriverManager

options = webdriver.ChromeOptions() 
options.headless = True

options.page_load_strategy = 'none' 
chrome_path = ChromeDriverManager().install() 
chrome_service = Service(chrome_path) 

driver = Chrome(options=options, service=chrome_service) 
driver.implicitly_wait(5)
driver.maximize_window()

初始翻页代码（抛出异常） #

# 假设url和next_button_query已正确初始化
# 假设已实现判断是否存在下一页的逻辑

driver.get(url)
delay = 20 # 秒
while there_is_a_next_page:
   next_button = WebDriverWait(self.driver, delay).until(EC.element_to_be_clickable((By.CSS_SELECTOR, 
   next_button_query)))
   next_button.click()

临时可行但低效的代码 #

# 假设url和next_button_query已正确初始化
# 假设已实现判断是否存在下一页的逻辑

driver.get(url)
while there_is_a_next_page:
   time.sleep(1)
   next_button.click()

1. 解决元素遮挡问题 #

元素被判定为可点击但实际被遮罩、弹窗等遮挡时，用JavaScript直接触发点击绕开交互限制：

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

while there_is_a_next_page:
    # 先等待元素存在
    next_button = WebDriverWait(driver, 20).until(
        EC.presence_of_element_located((By.CSS_SELECTOR, next_button_query))
    )
    # 等待页面加载遮罩消失（需替换为实际遮罩的选择器）
    WebDriverWait(driver, 20).until(
        EC.invisibility_of_element_located((By.CSS_SELECTOR, ".loading-overlay"))
    )
    # 执行JS点击
    driver.execute_script("arguments[0].click();", next_button)

2. 确保元素在视口中可见 #

元素不在当前视图范围内时，点击也会失败，可先滚动到元素位置再等待点击：

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.action_chains import ActionChains

while there_is_a_next_page:
    next_button = WebDriverWait(driver, 20).until(
        EC.element_to_be_clickable((By.CSS_SELECTOR, next_button_query))
    )
    # 滚动到元素所在位置
    ActionChains(driver).move_to_element(next_button).perform()
    # 再次确认元素可点击
    WebDriverWait(driver, 5).until(
        EC.element_to_be_clickable((By.CSS_SELECTOR, next_button_query))
    )
    next_button.click()

3. 避免隐式与显式等待冲突 #

同时设置隐式等待和显式等待会导致等待逻辑混乱，建议移除隐式等待，统一使用显式等待：

# 初始化Driver时删除此行：driver.implicitly_wait(5)

4. 等待页面状态稳定 #

翻页后页面DOM频繁更新时，等待文档加载完成再进行下一步操作：

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

def wait_for_page_ready(driver, timeout=20):
    WebDriverWait(driver, timeout).until(
        lambda d: d.execute_script('return document.readyState') == 'complete'
    )

while there_is_a_next_page:
    next_button = WebDriverWait(driver, 20).until(
        EC.element_to_be_clickable((By.CSS_SELECTOR, next_button_query))
    )
    next_button.click()
    # 等待页面加载完成
    wait_for_page_ready(driver)

内容的提问来源于stack exchange，提问作者RichS