如何通过文本搜索包含其他标签的标签？BeautifulSoup.find(text=)咨询

Great question! You’ve hit on a common gotcha with BeautifulSoup.find(text=...)—this method only looks for individual NavigableString nodes (plain text chunks without child elements). If the text you’re targeting is mixed with other tags (like <span>Hello <b>there</b></span>), the text parameter won’t find it because the full text is split across multiple nodes.

Luckily, there are a couple of reliable workarounds:

1. Use a Lambda Function with get_text() #

You can pass a lambda to find() that extracts the full text of a tag (including text from child elements) and checks if it matches your target. This gives you full control over exact matches (with or without stripping whitespace).

Example:
Suppose your HTML looks like this:

<div class="content">
  I love <span>BeautifulSoup</span>!
</div>

To find this <div> by the full text "I love BeautifulSoup!", use:

from bs4 import BeautifulSoup

html = """
<div class="content">
  I love <span>BeautifulSoup</span>!
</div>
"""

soup = BeautifulSoup(html, "html.parser")
target_element = soup.find(lambda tag: tag.get_text(strip=True) == "I love BeautifulSoup!")

print(target_element)
# Output: <div class="content">
#          I love <span>BeautifulSoup</span>!
#        </div>

The strip=True removes extra whitespace (like newlines or spaces) to ensure an exact match.

2. Use CSS Selectors with :contains() #

If you’re using BeautifulSoup 4.7.0 or newer, you can leverage the :contains() CSS pseudo-class. This selects elements that contain the specified substring (case-sensitive), regardless of child tags.

Using the same HTML example:

target_element = soup.select_one('div:contains("I love BeautifulSoup!")')

Or if you only need to match a part of the text:

target_element = soup.select_one('div:contains("BeautifulSoup")')

Note: :contains() matches substrings, so if you need an exact match, the lambda method above is better.

3. Combine Regex with get_text() (For Partial/Pattern Matches) #

If you need to match a pattern instead of exact text, you can combine a regex with the lambda approach:

import re

target_element = soup.find(lambda tag: re.search(r"love.*BeautifulSoup", tag.get_text(strip=True)))

All these methods let you search for text that’s wrapped alongside other tags, which the basic find(text=...) can’t handle.

内容的提问来源于stack exchange，提问作者user1424739