pandas逐行计算D、E列仅返回前几行结果,如何计算到DataFrame末尾
问题原因
- NaN判断逻辑错误:
numpy.nan用==和任何值比较都会返回False,你写的空值替换逻辑完全没有执行,C列的空值一直存在,后续计算E列时会直接得到NaN,下一轮用NaN计算自然全是空值 - 链式索引风险:直接用
.iloc对列切片赋值属于链式索引,可能触发pandas的SettingWithCopyWarning,导致赋值不生效
修复后完整代码
import pandas import numpy pandas.set_option('display.max_columns', None) pandas.set_option('display.max_rows', None) pandas.set_option('display.width', None) df1 = pandas.read_json("""{"A":{"1062374400000":0.004270709,"1064966400000":0.010686493,"1067644800000":0.006375888,"1070236800000":0.006175395,"1072915200000":0.007879588,"1075593600000":0.01078674,"1078099200000":0.006375888,"1080777600000":0.008180328,"1083369600000":0.006576382,"1086048000000":0.006476135},"B":{"1062374400000":0.0590058044,"1064966400000":0.4393213977,"1067644800000":0.4708762019,"1070236800000":0.6544813354,"1072915200000":1.154254136,"1075593600000":null,"1078099200000":null,"1080777600000":null,"1083369600000":null,"1086048000000":null},"C":{"1062374400000":-0.0309941956,"1064966400000":0.1993213977,"1067644800000":0.0508762019,"1070236800000":0.2044813354,"1072915200000":0.514254136,"1075593600000":null,"1078099200000":null,"1080777600000":null,"1083369600000":null,"1086048000000":null},"D":{"1062374400000":null,"1064966400000":null,"1067644800000":null,"1070236800000":null,"1072915200000":null,"1075593600000":null,"1078099200000":null,"1080777600000":null,"1083369600000":null,"1086048000000":null},"E":{"1062374400000":null,"1064966400000":null,"1067644800000":null,"1070236800000":null,"1072915200000":null,"1075593600000":null,"1078099200000":null,"1080777600000":null,"1083369600000":null,"1086048000000":null}} """) # 提前统一把C列空值替换为0,省略循环内判断逻辑 df1['C'] = df1['C'].fillna(0) # 初始化E列首值 e_prev = df1['C'].iloc[0] df1.loc[df1.index[0], 'E'] = e_prev # 循环计算后续D、E值 for i in range(1, len(df1)): current_idx = df1.index[i] a_current = df1['A'].iloc[i] c_current = df1['C'].iloc[i] d_current = e_prev * a_current e_current = e_prev + c_current + d_current # 用loc方式赋值,符合pandas官方规范 df1.loc[current_idx, 'D'] = d_current df1.loc[current_idx, 'E'] = e_current # 缓存上一轮E值,避免重复读取DataFrame e_prev = e_current print(df1.round(6))
优化说明
- 提前用
fillna(0)批量处理C列空值,性能更高也避免了循环内判断的出错概率 - 用变量缓存上一轮E值,不需要反复从DataFrame中读取数据,运行效率更高
- 采用
df.loc[index, 列名]的方式赋值,完全避免链式索引带来的赋值失效问题 - A列全为有效值、上一轮E值也始终为有效值,计算出的D列不会出现空值,无需额外判断处理
内容的提问来源于stack exchange,提问作者André Luís
相关产品推荐
相关产品推荐

