使用Python3爬取股票数据并按指定格式输出CSV遇排布问题
问题原因
你当前的CSV写入逻辑是将所有股票代码作为第一行、所有股票名称作为第二行写入文件,自然无法得到「代码+名称逐行对应」的格式。
修复方案
仅需修改CSV写入部分的代码,用zip()函数将两个列表里的代码和名称按位置一一配对,逐行写入即可:
# 保留之前的爬取代码不变,仅修改下面的CSV写入部分 with open('data.csv', 'w', encoding='utf-8-sig') as file: writer = csv.writer(file, lineterminator='\n') # 可选:写入表头 writer.writerow(['股票代码', '股票名称']) # 配对代码和名称逐行写入 for code, name in zip(l, t): writer.writerow([code, name])
添加encoding='utf-8-sig'参数可以避免Windows系统下打开CSV出现中文乱码的问题。
完整优化后代码
from bs4 import BeautifulSoup import requests import csv import time # 用于添加延时防反爬 # Yahoo!finance url = "https://info.finance.yahoo.co.jp/ranking/?kd=27&mk=1&tm=d&vl=a" code_list = [] name_list = [] num = 1 while num <= 51: r = requests.get(url) soup = BeautifulSoup(r.text, 'html.parser') codes = soup.select("#contents-body-bottom > div.rankdata > div.rankingTableWrapper > table > tbody > tr:nth-child(" + str(num) + ") > td:nth-child(1) > a") if len(codes) == 0: break num += 1 for code in codes: code_list.append(code.text) base_url = "https://kabutan.jp/stock/?code=" for code in code_list: url = base_url + code r = requests.get(url) soup = BeautifulSoup(r.text, 'html.parser') titles = soup.select("#kobetsu_right > div.company_block > h3") time.sleep(1) # 1秒延时避免触发网站反爬规则 for title in titles: name_list.append(title.text) # 导出CSV with open('data.csv', 'w', encoding='utf-8-sig') as file: writer = csv.writer(file, lineterminator='\n') writer.writerow(['股票代码', '股票名称']) for code, name in zip(code_list, name_list): writer.writerow([code, name])
内容的提问来源于stack exchange,提问作者polt
相关产品推荐
相关产品推荐

