如何提取多组指定HTML结构中的所有a href链接？

Hey there! Extracting all a href links from that HTML structure is a common task, and there are a few solid ways to do it depending on your toolset. Let me walk you through the most practical options:

This is the go-to approach because HTML can be messy—think unclosed tags, inconsistent formatting—and a proper parser handles all those edge cases way better than regex.

First, install the required package if you haven’t already:

pip install beautifulsoup4 requests  # Requests is optional if you're reading from a local file

Then write a simple script to parse your HTML and extract the links:

from bs4 import BeautifulSoup

# If your HTML is stored in a local file:
with open("your_html_file.html", "r") as f:
    html_content = f.read()

# Or if you're fetching it directly from a URL:
# import requests
# html_content = requests.get("https://your-target-site.com").text

soup = BeautifulSoup(html_content, "html.parser")

# Grab all <a> tags and extract their href attributes (skip empty ones)
all_links = [a_tag.get("href") for a_tag in soup.find_all("a") if a_tag.get("href")]

# Print or save the results
for link in all_links:
    print(link)

Pro tip: If you need to convert relative paths like /xx/xxx to absolute URLs, use urllib.parse.urljoin:

from urllib.parse import urljoin

base_url = "https://your-domain.com"
absolute_links = [urljoin(base_url, link) for link in all_links]

If you’re dealing with perfectly formatted HTML and just need a fast extract, regex can work. But warning: regex isn’t designed for HTML, so it might break if the markup is inconsistent (e.g., single quotes instead of double, extra spaces around =).

Here’s a Python example with regex:

import re

html_content = """Your raw HTML content here"""

# Pattern that handles single/double quotes and spaces around the = sign
pattern = r'href\s*=\s*["\']([^"\']+)["\']'
matches = re.findall(pattern, html_content)

for link in matches:
    print(link)

Or from the command line with grep (Linux/macOS):

grep -oP 'href\s*=\s*["\']\K[^"\']+' your_html_file.html

The -oP flags let grep output only the matched part, and \K tells it to ignore everything before that point.

If you prefer command-line tools but want the reliability of a parser, pup is a great choice—it’s a lightweight command-line HTML parser. Install it first, then run:

cat your_html_file.html | pup 'a attr{href}'

This will output every href attribute from <a> tags without any regex headaches.

内容的提问来源于stack exchange，提问作者David Matrick