Python Selenium如何选中所有可见与隐藏的邮件元素？

Ah, I’ve been in your shoes with this exact problem—Selenium’s find_elements_by_xpath only grabs elements that are loaded in the DOM (and often visible in the viewport), which is why you’re stuck with just those 25 visible emails. Lazy-loaded email lists like this are super common, but here are two reliable ways to capture every single email element:

Method 1: Scroll to Load All Emails First #

Most email clients load more messages when you scroll to the bottom of the list. We can automate this scrolling loop until no new emails load, then grab all elements at once.

import time
from selenium import webdriver

# Initialize your driver (adjust as needed)
driver = webdriver.Chrome()

# Start by getting the initial count of visible emails
email_count = len(driver.find_elements_by_xpath("//div[@data-time]"))

while True:
    # Scroll to the very bottom of the page to trigger lazy load
    driver.execute_script("window.scrollTo(0, document.body.scrollHeight);")
    
    # Wait a bit for new emails to load (replace with explicit wait for better reliability)
    time.sleep(2)
    
    # Check the new count of emails
    new_email_count = len(driver.find_elements_by_xpath("//div[@data-time]"))
    
    # If no new emails loaded, we're done
    if new_email_count == email_count:
        break
    
    # Update the count for the next iteration
    email_count = new_email_count

# Now grab all email elements—this will include every loaded message
all_emails = driver.find_elements_by_xpath("//div[@data-time]")

Pro tip: Replace time.sleep(2) with an explicit wait (using WebDriverWait and expected_conditions) to wait for new elements to appear. This makes the script more robust, as it won’t waste time waiting if emails load faster, and won’t fail if they take a bit longer.

Method 2: Use JavaScript to Fetch All DOM Elements Directly #

Selenium relies on the DOM state, but JavaScript can access every element matching your selector—even if they’re hidden or not yet scrolled into view. This is a faster approach if you don’t need full Selenium WebElement objects, or if you want to manipulate elements directly via JS.

Get all elements (as DOM objects): #

# Execute JS to fetch all divs with the data-time attribute
all_email_dom_elements = driver.execute_script("return document.querySelectorAll('div[data-time]');")

If you want to select all emails directly (set aria-selected to true): #

If your goal is to select every email, you can do it all in one JS call without even collecting elements first:

driver.execute_script("""
    // Grab all email elements
    const emails = document.querySelectorAll('div[data-time]');
    
    // Loop through and mark each as selected
    emails.forEach(email => {
        email.setAttribute('aria-selected', 'true');
        // If selecting requires a click event, uncomment the line below:
        // email.dispatchEvent(new Event('click', { bubbles: true }));
    });
""")

Note: The DOM objects returned by document.querySelectorAll aren’t Selenium WebElements, so you can’t use Selenium methods like .click() on them directly. If you need to use Selenium’s API, stick with Method 1.

Which Method Should You Use? #

• Use Method 1 if you need to interact with emails using Selenium’s built-in methods (like clicking, extracting text, etc.).
• Use Method 2 if you just need to select all emails quickly, or if you prefer manipulating elements directly in the DOM.

内容的提问来源于stack exchange，提问作者M.Naveed