如何获取两个列表并集的所有字段名以导出CSV？

问题根源 #

你当前的代码只是简单合并了两个字典列表，但两个列表里的字典字段完全不重叠。导出CSV时，csv.DictWriter要求所有字典的字段必须都在指定的fieldnames里，否则就会抛出ValueError。

解决步骤 #

1. 收集所有字段的并集 #

先遍历两个列表的所有字典，把所有键收集起来去重，得到完整的字段列表：

amazondata = [{'amzlink': 'https://www.amazon.com/dp/B084ZZ7VY3', 'asin': 'B084ZZ7VY3', 'url': 'https://www.amazon.com/s?k=712145360504&s=review-rank'}]
amazonPage = [{'price': '$14.95', 'image': 'https://m.media-amazon.com/images/I/81D1P4QqLfL._AC_SX425_.jpg', 'rating': '4.7 out of 5'}]

# 收集所有字段名并去重
all_fields = set()
for item in amazondata + amazonPage:
    all_fields.update(item.keys())
all_fields = list(all_fields)  # 转成列表方便后续使用

2. 统一所有字典的字段 #

让每个字典都包含所有字段，缺失的字段用None（或空字符串）填充：

result = []
for item in amazondata + amazonPage:
    # 遍历所有字段，存在的取原值，不存在的补None
    unified_item = {field: item.get(field, None) for field in all_fields}
    result.append(unified_item)

3. 导出CSV文件 #

用收集到的完整字段列表作为fieldnames，就能正常导出：

import csv

with open('amazon_data.csv', 'w', newline='', encoding='utf-8') as csvfile:
    writer = csv.DictWriter(csvfile, fieldnames=all_fields)
    writer.writeheader()  # 写入表头
    writer.writerows(result)  # 写入所有数据

完整代码 #

import csv

amazondata = [{'amzlink': 'https://www.amazon.com/dp/B084ZZ7VY3', 'asin': 'B084ZZ7VY3', 'url': 'https://www.amazon.com/s?k=712145360504&s=review-rank'}]
amazonPage = [{'price': '$14.95', 'image': 'https://m.media-amazon.com/images/I/81D1P4QqLfL._AC_SX425_.jpg', 'rating': '4.7 out of 5'}]

# 收集所有字段的并集
all_fields = set()
for item in amazondata + amazonPage:
    all_fields.update(item.keys())
all_fields = list(all_fields)

# 统一字典字段
result = []
for item in amazondata + amazonPage:
    unified_item = {field: item.get(field, None) for field in all_fields}
    result.append(unified_item)

# 导出CSV
with open('amazon_data.csv', 'w', newline='', encoding='utf-8') as csvfile:
    writer = csv.DictWriter(csvfile, fieldnames=all_fields)
    writer.writeheader()
    writer.writerows(result)

内容的提问来源于stack exchange，提问作者Alex 111