Selenium无头模式无法定位元素问题（Ubuntu 22.04环境）

核心问题分析 #

从日志和代码来看，ChromeDriver与Chrome版本匹配正常，页面也成功加载，但无法定位元素，主要原因包括：

• 无头模式下浏览器特征被网站识别，导致页面未正常渲染目标元素
• 代码中try-finally的写法存在逻辑错误，超时后会触发未定义变量错误
• 缺少必要的无头模式配置参数，无法模拟真实浏览器环境

解决方案 #

1. 完善无头Chrome的配置参数 #

添加以下参数伪装真实浏览器环境，避免被反爬机制拦截：

chrome_options = webdriver.ChromeOptions()
chrome_options.add_argument("--headless=new")
# 添加必要的伪装及兼容性参数
chrome_options.add_argument("--disable-blink-features=AutomationControlled")
chrome_options.add_argument("--no-sandbox")  # 解决Linux下权限限制问题
chrome_options.add_argument("--disable-dev-shm-usage")  # 避免共享内存不足导致的崩溃
chrome_options.add_argument("user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36")
chrome_options.add_experimental_option("excludeSwitches", ["enable-automation"])
chrome_options.add_experimental_option('useAutomationExtension', False)

2. 修正代码中的try-finally逻辑 #

原代码中finally块会在WebDriverWait超时后强制执行，此时username_locator未被赋值，会引发新的错误。应改为try-except处理超时，确保元素定位成功后再操作：

# 修正后的用户名定位逻辑
try:
    username_locator = WebDriverWait(driver, 10).until(
        EC.visibility_of_element_located((By.ID, 'username'))  # 用visibility替代presence，确保元素可见且可交互
    )
    username_locator.send_keys('student')
    print("username text field got")
except TimeoutException:
    print("无法定位用户名输入框，保存截图排查")
    driver.save_screenshot('username_timeout.png')
    driver.quit()
    exit()

3. 验证页面状态 #

在定位元素前，添加页面状态检查，确认页面是否正常加载：

driver.get("https://practicetestautomation.com/practice-test-login/")
print("页面标题:", driver.title)
# 打印页面源码片段，确认目标元素是否存在
print("页面源码片段:", driver.page_source[:1000])

4. 检查元素定位器准确性 #

• 手动访问目标页面，右键检查元素，确认username输入框的id确实为username
• 若页面存在iframe，需先切换到iframe再定位元素（当前测试页面无iframe，但需排查此类场景）

完整修正后的代码 #

import time
from selenium.webdriver.common.by import By
from selenium import webdriver
from selenium.webdriver.support.wait import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.common.exceptions import TimeoutException
import logging

log_path = './log'
logger = logging.getLogger('selenium')
logger.setLevel(logging.DEBUG)
handler = logging.FileHandler(log_path)
logger.addHandler(handler)
logging.getLogger('selenium.webdriver.common').setLevel(logging.DEBUG)
logger.debug("this is detailed debug information:")

chrome_options = webdriver.ChromeOptions()
chrome_options.add_argument("--headless=new")
chrome_options.add_argument("--disable-blink-features=AutomationControlled")
chrome_options.add_argument("--no-sandbox")
chrome_options.add_argument("--disable-dev-shm-usage")
chrome_options.add_argument("user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36")
chrome_options.add_experimental_option("excludeSwitches", ["enable-automation"])
chrome_options.add_experimental_option('useAutomationExtension', False)

driver = webdriver.Chrome(options=chrome_options)

# 访问目标页面
driver.get("https://practicetestautomation.com/practice-test-login/")
print("页面标题:", driver.title)

# 输入用户名
try:
    username_locator = WebDriverWait(driver, 10).until(
        EC.visibility_of_element_located((By.ID, 'username'))
    )
    username_locator.send_keys('student')
    print("username text field got")
except TimeoutException:
    print("无法定位用户名输入框，保存截图排查")
    driver.save_screenshot('username_error.png')
    driver.quit()
    exit()

# 输入密码
try:
    password_locator = WebDriverWait(driver, 10).until(
        EC.visibility_of_element_located((By.NAME, "password"))
    )
    password_locator.send_keys('Password123')
except TimeoutException:
    print("无法定位密码输入框")
    driver.quit()
    exit()

# 点击提交按钮
try:
    button = WebDriverWait(driver, 10).until(
        EC.element_to_be_clickable((By.XPATH, "//button[@class='btn']"))
    )
    button.click()
except TimeoutException:
    print("无法定位提交按钮")
    driver.quit()
    exit()

# 验证登录结果
try:
    success_msg = WebDriverWait(driver, 10).until(
        EC.visibility_of_element_located((By.CSS_SELECTOR, ".post-title"))
    )
    print("登录成功，页面提示:", success_msg.text)
except TimeoutException:
    print("登录后未找到成功提示")

driver.quit()

内容的提问来源于stack exchange，提问作者J. Abe