基于Python+Feedparser从多RSS源提取文章图片的技术求助

1. 重构查找逻辑，替代嵌套Try-Except #

把分散的图片查找逻辑改成可扩展的查找器列表，既清晰又方便后续新增规则，避免嵌套代码的臃肿：

# 定义各类型图片的查找函数
def get_enclosure_image(entry):
    if hasattr(entry, 'enclosures') and entry.enclosures:
        return str(entry.enclosures[0].href)

def get_media_content_image(entry):
    if hasattr(entry, 'media_content') and entry.media_content:
        return entry.media_content[0].get('url')

def get_content_html_image(entry):
    if hasattr(entry, 'content') and entry.content:
        return entry.content[0].get('value')

def get_itunes_image(entry):
    # 适配itunes命名空间的图片字段
    return entry.get('itunes_image', {}).get('href')

# 按可靠性排序的查找器列表，优先级从高到低
image_finders = [
    get_enclosure_image,
    get_media_content_image,
    get_itunes_image,
    get_content_html_image,
]

post_image = "no image found"
# 遍历查找器，找到有效图片就停止
for finder in image_finders:
    try:
        candidate = finder(c)
        if candidate:
            sanitized_img = sanitize_url(candidate)
            if sanitized_img != "no image found":
                post_image = sanitized_img
                break
    except Exception:
        continue

2. 增强sanitize_url的HTML解析能力 #

原逻辑处理content字段时直接传入整个HTML字符串，需先提取其中的<img>标签src再处理：

from bs4 import BeautifulSoup
from urllib.parse import urlparse, urlunparse
import re

def sanitize_url(input_str):
    # 第一步：从HTML中提取img的src
    if '<img' in input_str:
        try:
            soup = BeautifulSoup(input_str, 'html.parser')
            img_tag = soup.find('img')
            if img_tag:
                input_str = img_tag.get('src', '')
        except Exception:
            pass

    # 第二步：匹配提取有效URL（过滤非链接内容）
    url_pattern = re.compile(r'https?://[^\s<>"]+')
    url_match = url_pattern.search(input_str)
    if not url_match:
        return "no image found"
    raw_url = url_match.group()

    # 第三步：移除URL的查询参数
    parsed_url = urlparse(raw_url)
    cleaned_url = urlunparse(
        (parsed_url.scheme, parsed_url.netloc, parsed_url.path, '', '', '')
    )

    # 第四步：验证图片格式（后缀或MIME类型二选一）
    allowed_extensions = ('.jpg', '.jpeg', '.png', '.gif', '.webp')
    if cleaned_url.lower().endswith(allowed_extensions):
        return cleaned_url
    # 更严谨的MIME校验（可选，需请求头）
    # try:
    #     import requests
    #     resp = requests.head(cleaned_url, allow_redirects=True, timeout=3)
    #     if resp.headers.get('Content-Type', '').startswith('image/'):
    #         return cleaned_url
    # except Exception:
    #     pass
    return "no image found"

3. 利用Feedparser的命名空间自动解析 #

Feedparser会自动处理RSS/Atom的各种命名空间字段，比如itunes:image、atom:logo等，直接在查找器里新增对应规则即可，无需手动解析XML命名空间。

4. 配置化适配特殊RSS源 #

针对少数结构异常的源，用配置字典做自定义规则，避免修改核心逻辑：

# 特殊源自定义查找规则，key为RSS源的URL
source_specific_rules = {
    "https://example.com/feed": lambda entry: entry.get('custom_image_field', {}).get('url'),
    "https://special-source.org/rss": lambda entry: entry.summary.split('img src="')[1].split('"')[0]
}

# 先尝试特殊源规则，失败再走通用逻辑
current_source = "https://example.com/feed"  # 当前拉取的RSS源URL
if current_source in source_specific_rules:
    try:
        candidate = source_specific_rules[current_source](c)
        if candidate:
            sanitized_img = sanitize_url(candidate)
            if sanitized_img != "no image found":
                post_image = sanitized_img
    except Exception:
        # 规则失败，回退到通用查找
        pass

5. 降级到频道级图片 #

如果文章级图片完全找不到，可尝试用RSS频道的封面图作为备选，比固定备用图片更贴合内容：

if post_image == "no image found":
    try:
        # feed为Feedparser解析整个RSS源后的对象
        channel_img = feed.feed.image.href
        post_image = sanitize_url(channel_img)
    except Exception:
        post_image = "你的备用图片URL"

内容的提问来源于stack exchange，提问作者AlexAntra