批量加载数据集时R列名编号偏移及SUMIF函数适配需求

我需要完成两项任务：一是实现R版Excel SUMIF函数，用于连续评估多数据集的模型性能；二是在多数据集及对应真实模型上复现此前的计算操作。但批量加载文件夹内的数据集时遇到关键问题：

• R自动将31列命名为V1至V31，无法轻松为每个数据集重命名列名
• 后续生成的IVs_Selected_by_BE和True_Regressors中，列名后缀数字比正确值大1，导致标识错误

单数据集处理代码与输出 #

df <- read.csv("0-11-3-462.csv", header = FALSE)
# 修改数据框df的所有列名
colnames(df) <- c("Y", "X1","X2", "X3", "X4","X5", "X6", "X7","X8", "X9",
                  "X10","X11", "X12", "X13","X14", "X15", "X16","X17", 
                  "X18", "X19","X20", "X21", "X22","X23", "X24", "X25",
                  "X26", "X27", "X28","X29", "X30")
True_IVs <- df[1, -1]

输出：

> str(True_IVs)
'data.frame':   1 obs. of  30 variables:
 $ X1 : chr "0"
 $ X2 : chr "0"
 $ X3 : chr "0"
 $ X4 : chr "1"
 $ X5 : chr "0"
 $ X6 : chr "0"
 $ X7 : chr "0"
 $ X8 : chr "0"

批量数据集处理代码 #

filepaths_list <- list.files(path = filepath, full.names = TRUE, recursive = TRUE)
datasets <- lapply(filepaths_list, read.csv, header = FALSE)

True_IVs <- lapply(datasets, function(j) {j[1, -1]})

datasets <- lapply(datasets, function(i) {i[-1:-3, ]})
datasets <- lapply(datasets, \(X) { lapply(X, as.numeric) })

数据集输出示例 #

> head(datasets[[1]], n = 5)
                 V1           V2          V3          V4           V5
1 Regressor present            0           0           0            1
2                              1           2           3            4
3                 Y           X1          X2          X3           X4
4       4.119024459 -1.350655759 1.901787258 0.205749783  0.242920532
5       1.737430635   0.26677565 0.054290757 1.510124319 -0.618655652
            V6           V7          V8           V9         V10
1            0            0           0            0           0
2            5            6           7            8           9
3           X5           X6          X7           X8          X9
4 -0.405946237 -0.667673545 0.745735562  0.143317951 1.376182976
5  0.289294477 -0.220927214 0.251479422 -0.094245944 0.792214818

IVs_Selected_by_BE输出 #

> IVs_Selected_by_BE
[[1]]
 [1] "V3"  "V4"  "V5"  "V6"  "V9"  "V11" "V14" "V16" "V18" "V20" "V21"
[12] "V23" "V26" "V27" "V28" "V29" "V31"

[[2]]
 [1] "V3"  "V6"  "V7"  "V8"  "V9"  "V12" "V13" "V14" "V15" "V17" "V18"
[12] "V21" "V22" "V23" "V24" "V25" "V26" "V30"

True_Regressors输出 #

True_Regressors now as well:
[[1]]
 [1] "V5"  "V11" "V14" "V20" "V21" "V23" "V26" "V27" "V28" "V29" "V31"

[[2]]
 [1] "V7"  "V8"  "V14" "V15" "V17" "V18" "V21" "V22" "V24" "V26" "V30"

获取True_Regressors的代码 #

True_Regressors <- lapply(True_IVs, function(i) { names(i)[i == 1] })
# 对比单数据集情况的代码
# True_Regressors <- names(True_IVs)[True_IVs == 1]

核心问题 #

所有列名中V右侧的数字均比正确值大1，导致后续模型性能评估的标识错误。

解决方案 #

1. 批量重命名数据集列名 #

在读取数据集时直接设置统一的正确列名，与单数据集处理逻辑保持一致：

filepaths_list <- list.files(path = filepath, full.names = TRUE, recursive = TRUE)
# 定义统一列名
col_names <- c("Y", paste0("X", 1:30))

datasets <- lapply(filepaths_list, function(file) {
  df <- read.csv(file, header = FALSE)
  colnames(df) <- col_names
  df
})

2. 修正True_IVs提取与True_Regressors生成 #

# 提取真实IVs（第一行，去掉Y列）
True_IVs <- lapply(datasets, function(j) {j[1, -1]})

# 处理数据集（去掉前3行并转为数值型）
datasets <- lapply(datasets, function(i) {i[-1:-3, ]})
datasets <- lapply(datasets, function(X) { lapply(X, as.numeric) })

# 生成正确的True_Regressors
True_Regressors <- lapply(True_IVs, function(i) { names(i)[i == 1] })

3. 修正IVs_Selected_by_BE的列名 #

如果IVs_Selected_by_BE是其他流程生成的V前缀列名，批量替换为正确的X前缀：

IVs_Selected_by_BE <- lapply(IVs_Selected_by_BE, function(vs) {
  # 提取V后的数字，减1后转为X前缀
  nums <- as.integer(sub("V", "", vs)) - 1
  paste0("X", nums)
})

内容的提问来源于Stack Exchange，提问作者Marlen