处理PDF提取数据:Pandas DataFrame基于当前行补全前一行Type字段
解决PDF提取DataFrame的格式整理问题
问题分析
你需要处理从格式混乱的PDF中提取的DataFrame:当Amount列为空时,将该行的Transaction details内容(Purchase仅保留关键词)赋值给上一行的Type列,最后删除这些空金额行。你之前的循环代码逻辑有误,导致未得到预期结果。
错误代码问题点
你的循环代码存在两个核心问题:
- 条件判断
df[df['Transaction details'].str.contains("Transfer|Purchase")==True]返回的是布尔索引筛选后的DataFrame,而非单个布尔值,因此循环中该条件始终为真,导致错误赋值。 - 未判断
Amount是否为空,会错误处理所有包含Transfer/Purchase的行,而非仅空金额行。
正确解决方案
以下是高效的向量化解法(避免低效循环):
1. 构造示例数据(模拟你提供的原始DataFrame)
import pandas as pd data = [ ["01 Dec 2022", "Round up to Round-up", -0.77, 3344.67, ""], ["", "Transfer", "", "", ""], ["01 Dec 2022", "School", -12.01, 3332.66, ""], ["", "Purchase EUR 13.87 FX rate £1 = €1.1549", "", "", ""], ["01 Dec 2022", "Round up to Round-up", -0.67, 3331.99, ""], ["", "Transfer", "", "", ""], ["01 Dec 2022", "Restaurant", -21.39, 3310.6, ""], ["", "Purchase EUR 24.70 FX rate £1 = €1.1547", "", "", ""], ["01 Dec 2022", "Round up to Round-up", -0.75, 3309.85, ""], ["", "Transfer", "", "", ""], ["01 Dec 2022", "Shop", -48.64, 3261.21, ""], ["", "Purchase EUR 56.18 FX rate £1 = €1.1550", "", "", ""], ["01 Dec 2022", "Am", -6.06, 3255.15, ""] ] df = pd.DataFrame(data, columns=["Date", "Transaction details", "Amount", "Balance", "Type"])
2. 提取空金额行的Type关键词
针对空Amount行,用正则提取Transfer或Purchase关键词(自动截断Purchase后的冗余内容):
# 筛选空Amount行,提取Type关键词 type_values = df.loc[df['Amount'].isna(), 'Transaction details'].str.extract(r'(Transfer|Purchase)', expand=False)
3. 将关键词赋值到上一行的Type列
利用索引偏移,把提取到的Type值对应赋值到上一行:
df.loc[type_values.index - 1, 'Type'] = type_values.values
4. 删除空金额行并重置索引
df_cleaned = df.dropna(subset=['Amount']).reset_index(drop=True)
最终结果
处理后的df_cleaned与你给出的理想结果完全一致:
| Date | Transaction details | Amount | Balance | Type |
|---|---|---|---|---|
| 01 Dec 2022 | Round up to Round-up | -0.77 | 3344.67 | Transfer |
| 01 Dec 2022 | School | -12.01 | 3332.66 | Purchase |
| 01 Dec 2022 | Round up to Round-up | -0.67 | 3331.99 | Transfer |
| 01 Dec 2022 | Restaurant | -21.39 | 3310.6 | Purchase |
| 01 Dec 2022 | Round up to Round-up | -0.75 | 3309.85 | Transfer |
| 01 Dec 2022 | Shop | -48.64 | 3261.21 | Purchase |
| 01 Dec 2022 | Am | -6.06 | 3255.15 |
(注:理想结果中最后一行的Type为Purchase,若你的原始数据中该行对应有空金额行未展示,可补充处理逻辑,当前代码仅基于你提供的原始数据生成结果)
内容的提问来源于stack exchange,提问作者jacob89
相关产品推荐
相关产品推荐

