如何为从URL下载的CSV文件新增identifier列后再写入本地?
实现方法
这里提供两种常用实现方案,你可以根据自己的场景选择:
方案1:使用pandas实现(代码简洁,推荐)
需要先安装pandas依赖:
pip install pandas
修改后的完整代码:
import requests import pandas as pd from io import BytesIO numbers = ['00014798','00019323','00020949'] for number in numbers: # 替换为你实际的CSV地址拼接规则 csv_url = f"url前缀{number}url后缀" print(csv_url) req = requests.get(csv_url) # 跳过请求失败的资源 if req.status_code != 200: print(f"编号{number}的CSV请求失败,已跳过") continue # 读取远程CSV为DataFrame df = pd.read_csv(BytesIO(req.content)) # 新增identifier列,所有行值为当前number df['identifier'] = number # 写入本地文件,不导出索引列,utf-8-sig编码兼容Windows打开不乱码 df.to_csv(f"{number}.csv", index=False, encoding='utf-8-sig')
方案2:使用Python内置csv模块实现(无需额外安装依赖)
适合不想安装第三方库的场景,用Python标准库即可完成:
import requests import csv from io import StringIO numbers = ['00014798','00019323','00020949'] for number in numbers: # 替换为你实际的CSV地址拼接规则 csv_url = f"url前缀{number}url后缀" print(csv_url) req = requests.get(csv_url) if req.status_code != 200: print(f"编号{number}的CSV请求失败,已跳过") continue # 解码CSV内容,编码可根据实际情况调整为gbk等 csv_content = req.content.decode('utf-8') reader = csv.reader(StringIO(csv_content)) rows = list(reader) # 表头新增列名 rows[0].append('identifier') # 每行新增对应number值 for row in rows[1:]: row.append(number) # 写入本地文件 with open(f"{number}.csv", 'w', newline='', encoding='utf-8-sig') as f: writer = csv.writer(f) writer.writerows(rows)
注意事项
- 如果你的CSV本身没有表头,读取时可以给pandas加
header=None参数,或者给方案2的首行也新增number值即可 - 编码可根据实际CSV的编码规则调整,避免出现乱码问题
内容的提问来源于stack exchange,提问作者joeyops
相关产品推荐
相关产品推荐

