编写R函数批量读取分文件夹存储的46个Shapefile遇问题求助

Hey there! Let's tackle this Shapefile reading problem step by step—sounds like you're stuck dealing with a less-than-ideal folder structure but have to work within the nonprofit's rules, totally get that. Your stability issues and object assignment confusion are super common with this kind of scattered data setup, so let's break this down.

First, let's address why some Shapefiles might be failing to read. The usual culprits are:

• Missing supporting files: Shapefiles rely on paired .shx, .dbf, and sometimes .prj files—if any are missing from a folder, st_read (the go-to R function for spatial data) will throw errors.
• Case sensitivity issues: On macOS/Linux, file.shp and File.SHP are treated as different; using ignore.case = TRUE when searching for files can fix this.
• Encoding mismatches: If the attribute tables use non-ASCII characters, you might need to specify an encoding (like encoding = "UTF-8" or "GBK") in st_read.
• Permissions: Rare, but sometimes R can't access files if the folder has restricted read permissions.

Now, here's a robust function that handles these edge cases, captures errors, and organizes your data neatly:

Step 1: Load required packages #

We'll use sf (the standard for spatial data in R) and purrr for clean iteration:

library(sf)
library(purrr)

Step 2: The robust reading function #

This function will scan all target folders, read valid Shapefiles, log errors for problematic folders, and store everything in a named list (way cleaner than 46 separate objects cluttering your environment):

read_shapefiles_from_folders <- function(root_directory) {
  # Get all top-level folders in your root directory
  folder_paths <- list.dirs(path = root_directory, recursive = FALSE)
  
  # Iterate over each folder to read Shapefiles
  shapefile_list <- map(folder_paths, function(folder) {
    # Find all .shp files in the folder (ignore case for cross-platform compatibility)
    shp_files <- list.files(
      path = folder,
      pattern = "\\.shp$",
      full.names = TRUE,
      ignore.case = TRUE
    )
    
    # Check if any .shp files exist
    if (length(shp_files) == 0) {
      warning(paste("No Shapefile found in folder:", folder))
      return(NULL)
    }
    
    # Try reading the Shapefile, catch and log errors
    read_result <- tryCatch(
      expr = st_read(shp_files[1], quiet = TRUE), # Use quiet to suppress default messages
      error = function(e) {
        warning(paste("Failed to read folder", folder, ":", e$message))
        return(NULL)
      }
    )
    
    return(read_result)
  })
  
  # Name list elements after the folder names (easy to reference later)
  names(shapefile_list) <- basename(folder_paths)
  
  # Remove any NULL entries (folders that failed to read)
  shapefile_list <- shapefile_list[!sapply(shapefile_list, is.null)]
  
  return(shapefile_list)
}

Step 3: Use the function #

Point it to the root folder that contains all your 46 subfolders:

# Replace with your actual root directory path
my_shape_data <- read_shapefiles_from_folders("./nonprofit_shape_data")

Accessing your data #

Instead of juggling 46 separate objects, you can access individual Shapefiles using the folder name:

# Example: Access the Shapefile from the "2023_community_survey" folder
my_shape_data$2023_community_survey

If you really need separate objects (not recommended, since it clogs your environment), you can convert the list to global objects with:

list2env(my_shape_data, .GlobalEnv)

Troubleshooting failed reads #

Check the warning messages from the function—they'll tell you exactly which folders had issues. Go into those folders and verify:

1. All required Shapefile components (.shp, .shx, .dbf) are present
2. The .shp file isn't corrupted
3. If there are special characters in attribute tables, add an encoding parameter to st_read (e.g., st_read(shp_files[1], quiet = TRUE, encoding = "UTF-8"))

内容的提问来源于stack exchange，提问作者hmwaitwut