如何从网页提取关键词对应数据并导入Pandas DataFrame?
背景与原有实现
之前我通过规整的文本文件读取数据到Pandas DataFrame,代码如下:
import pandas as pd df = pd.read_table("organizedValues.txt", delimiter="\t")
当前待处理的数据情况
现在需要处理的分子数据来自独立网页,每个分子对应一个结构固定的网页,数据示例如下:
CH4 Methane 13.00000 Things in unit 4.00000 L, units in unit defintion 262.22300 mMass (lb/mol) 300.00000 K_0 (C) 100.45200 V_0 (m^3/mol) 719.08310 Eta_0 (-) 0.00000 Some parameter 0.00000 Another parameter 0.00000 Strain (-) 200.00000 K_1 (C)
尝试将网页数据保存为本地文件ch4.txt后,格式混乱,无法用read_table正常读取,文件片段如下:
{"name":"test2","path":"test2","contentType":"file"},{"name":"test5","path":"test5","contentType":"file"}],"totalCount":500}},"fileTreeProcessingTime":25,"foldersToFetch":[],"reducedMotionEnabled":null,"repo":{"id":yyy,"defaultBranch":"main","name":"code name","ownerLogin":"username","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-04-31T01:30:52.000Z","v=4","public":true,"private":false,"isOrgOwned":false},"symbolsExpanded":false,"treeExpanded":true,"refInfo":{"name":"main","listCacheKey":"XXX","canEdit":false,"refType":"branch","currentOid":"XXX"},"path":"or","currentUser":null,"blob":{"rawLines":["\nCH4 Methane "," 13.00000 Strain\n(-) "," 0.00000 K_0 (C)
"," 300.00000 Things in unit "," 13.00000
Eta_0 (-) "," 756
目标与需求
需要提取指定参数(如"Strain (-)"、"K_0 (C)"等)对应的数值,最终整理为如下结构的Pandas DataFrame:
Name Strain (-) K_0 (C) Things in unit Eta_0 (-) 1 CH4 0.00000 300.00000 13.00000 756
优先寻求直接从网页获取数据并转换为DataFrame的方案,无需保存本地文件。
内容的提问来源于stack exchange,提问作者Ant

