无法抓取单URL多页面政府仪表板数据的Selenium问题求助
抓取PMFBY统计仪表盘数据时遭遇Selenium TimeoutException问题
我需要抓取网站https://www.pmfby.gov.in/adminStatistics/dashboard的数据:进入初始页面后,实际要抓取第二屏的内容,页面包含各邦列表,每个邦对应5个子板块,同时还要切换季节下拉菜单中的Rabi和Kharif选项。由于所有页面的URL一致,我编写了以下Selenium代码尝试抓取表格数据:
from selenium import webdriver from selenium.webdriver.common.by import By from selenium.webdriver.support.ui import WebDriverWait from selenium.webdriver.support import expected_conditions as EC # 创建浏览器驱动对象并启动浏览器 driver = webdriver.Chrome() # 访问目标网站 driver.get("https://www.pmfby.gov.in/adminStatistics/dashboard") # 等待表格加载 table = WebDriverWait(driver, 20).until( EC.visibility_of_element_located((By.ID, "dataTable")) ) # 获取表格所有行 rows = table.find_elements(By.TAG_NAME, "tr") # 遍历行并打印数据 for row in rows: cols = row.find_elements(By.TAG_NAME, "td") for col in cols: print(col.text)
运行代码后触发了TimeoutException错误,具体错误信息如下:
TimeoutException: Message: Stacktrace: Backtrace: (No symbol) [0x002D37D3] (No symbol) [0x00268B81] (No symbol) [0x0016B36D] (No symbol) [0x0019D382] (No symbol) [0x0019D4BB] (No symbol) [0x001D3302] (No symbol) [0x001BB464] (No symbol) [0x001D1215] (No symbol) [0x001BB216] (No symbol) [0x00190D97] (No symbol) [0x0019253D] GetHandleVerifier [0x0054ABF2+2510930] GetHandleVerifier [0x00578EC1+2700065] GetHandleVerifier [0x0057C86C+2714828] GetHandleVerifier [0x00383480+645344] (No symbol) [0x00270FD2] (No symbol) [0x00276C68] (No symbol) [0x00276D4B] (No symbol) [0x00280D6B] BaseThreadInitThunk [0x76F800F9+25] RtlGetAppContainerNamedObjectPath [0x77677BBE+286] RtlGetAppContainerNamedObjectPath [0x77677B8E+238] (No symbol) [0x000000
我尝试改用Class Name定位元素,仍然出现相同的超时错误。
内容的提问来源于stack exchange,提问作者prateek singh
相关产品推荐
相关产品推荐

