R语言批量导入无表头CSV并添加列名后合并为数据框

问题根源 #

你遇到的向量大小不匹配、列规格不一致问题，是因为部分文件存在空列导致实际列数与指定列名数量不匹配；控制台的冗余输出则是read_csv默认的文件解析信息。

方案1：基于data.table（高效适配空列场景） #

利用fread的灵活性处理列数差异，统一调整列名和列数后合并：

library(data.table)

# 定义统一列名
col.names = c("ID", "NAMES_URI", "NAME1", "NAME1_LANG", "NAME2", "NAME2_LANG", 
              "TYPE", "LOCAL_TYPE", "GEOMETRY_X", "GEOMETRY_Y", 
              "MOST_DETAIL_VIEW_RES", "LEAST_DETAIL_VIEW_RES", "MBR_XMIN", 
              "MBR_YMIN", "MBR_XMAX", "MBR_YMAX", "POSTCODE_DISTRICT", 
              "POSTCODE_DISTRICT_URI", "POPULATED_PLACE", "POPULATED_PLACE_URI", 
              "POPULATED_PLACE_TYPE", "DISTRICT_BOROUGH", "DISTRICT_BOROUGH_URI", 
              "DISTRICT_BOROUGH_TYPE", "COUNTY_UNITARY", "COUNTY_UNITARY_URI", 
              "COUNTY_UNITARY_TYPE", "REGION", "REGION_URI", "COUNTRY", 
              "COUNTRY_URI", "RELATED_SPATIAL_OBJECT", "SAME_AS_DBPEDIA", 
              "SAME_AS_GEONAMES")

# 获取所有CSV文件的完整路径
csv_files <- list.files(pattern = "\\.csv$", full.names = TRUE)

# 批量导入、标准化列结构、合并数据
combined_data <- rbindlist(lapply(csv_files, function(file) {
  # 静默导入文件，不显示进度
  dt <- fread(file, header = FALSE, showProgress = FALSE)
  # 统一列数：截断多余列，补充不足的列为NA
  if (ncol(dt) > length(col.names)) dt <- dt[, 1:length(col.names)]
  if (ncol(dt) < length(col.names)) dt[, (setdiff(col.names, names(dt))) := NA]
  # 设置统一列名
  setnames(dt, col.names)
  return(dt)
}), fill = TRUE)

方案2：基于tidyverse（适配你的现有代码习惯） #

关闭冗余输出，强制统一列类型，同时处理列数不一致问题：

library(tidyverse)

# 定义统一列名（与上面一致）
col.names = c("ID", "NAMES_URI", "NAME1", "NAME1_LANG", "NAME2", "NAME2_LANG", 
              "TYPE", "LOCAL_TYPE", "GEOMETRY_X", "GEOMETRY_Y", 
              "MOST_DETAIL_VIEW_RES", "LEAST_DETAIL_VIEW_RES", "MBR_XMIN", 
              "MBR_YMIN", "MBR_XMAX", "MBR_YMAX", "POSTCODE_DISTRICT", 
              "POSTCODE_DISTRICT_URI", "POPULATED_PLACE", "POPULATED_PLACE_URI", 
              "POPULATED_PLACE_TYPE", "DISTRICT_BOROUGH", "DISTRICT_BOROUGH_URI", 
              "DISTRICT_BOROUGH_TYPE", "COUNTY_UNITARY", "COUNTY_UNITARY_URI", 
              "COUNTY_UNITARY_TYPE", "REGION", "REGION_URI", "COUNTRY", 
              "COUNTRY_URI", "RELATED_SPATIAL_OBJECT", "SAME_AS_DBPEDIA", 
              "SAME_AS_GEONAMES")

# 批量导入并合并
combined_data <- list.files(pattern = "\\.csv$") %>%
  map_dfr(function(file) {
    # 静默导入，关闭列类型输出
    df <- read_csv(file, header = FALSE, show_col_types = FALSE, col_names = FALSE)
    # 标准化列结构：截断多余列、补充空列、重命名并按指定顺序排列
    df <- df %>%
      select(1:length(col.names)) %>%
      set_names(col.names) %>%
      mutate(across(setdiff(col.names, names(.)), ~NA)) %>%
      select(all_of(col.names))
    return(df)
  })

关键说明 #

• 两种方案均处理了列数不一致问题：对列数超标的文件截断多余列，列数不足的补充NA值空列
• showProgress = FALSE（data.table）和show_col_types = FALSE（tidyverse）用于关闭控制台冗余输出
• rbindlist(fill = TRUE)和map_dfr结合列调整，确保合并时自动按列名匹配对齐

内容的提问来源于stack exchange，提问作者Saarek