如何用Python同时读取两目录下同名文件并同步处理

Got it, let's work through this problem together. The main goal here is to pair up files with matching base names from your two directories, so you can process them side-by-side and compare results easily. Here's a clean, Pythonic way to do this:

First, we'll use Python's built-in pathlib module (available in Python 3.4+) to handle file paths seamlessly across operating systems. The core steps are:

• Map files in each directory by their base name (without file extensions)
• Find files that exist in both directories (same base name)
• Open and process each paired file together

Full Code Example #

from pathlib import Path

def process_matched_files(dir_a: str, dir_b: str):
    # Convert directory strings to Path objects for intuitive path handling
    dir_a_path = Path(dir_a)
    dir_b_path = Path(dir_b)

    # Validate directories exist first (optional but helpful)
    if not dir_a_path.exists() or not dir_a_path.is_dir():
        print(f"Error: Directory {dir_a} does not exist or is not a directory.")
        return
    if not dir_b_path.exists() or not dir_b_path.is_dir():
        print(f"Error: Directory {dir_b} does not exist or is not a directory.")
        return

    # Create a dictionary mapping base names to .txt files in dir A
    txt_file_map = {file.stem: file for file in dir_a_path.glob("*.txt")}
    # Create a dictionary mapping base names to .csv files in dir B
    csv_file_map = {file.stem: file for file in dir_b_path.glob("*.csv")}

    # Find base names that are present in both directories
    common_base_names = set(txt_file_map.keys()) & set(csv_file_map.keys())

    if not common_base_names:
        print("No matching file pairs found between the two directories.")
        return

    # Process each pair of matching files
    for base_name in common_base_names:
        txt_file = txt_file_map[base_name]
        csv_file = csv_file_map[base_name]

        print(f"Now processing: {txt_file.name} (from dir A) and {csv_file.name} (from dir B)")

        # --- Replace this section with your custom processing logic ---
        # Example: Read the entire text file
        with open(txt_file, 'r', encoding='utf-8') as f:
            txt_content = f.read()
            # Do something with txt_content (e.g., parse metrics, extract values)

        # Example: Read CSV file using Python's csv module
        import csv
        with open(csv_file, 'r', encoding='utf-8') as f:
            csv_reader = csv.reader(f)
            header = next(csv_reader)  # Get CSV header if needed
            for row in csv_reader:
                # Process each CSV row (e.g., compare with txt data)

        # For easier CSV handling, use pandas (install via `pip install pandas`)
        # import pandas as pd
        # csv_df = pd.read_csv(csv_file)
        # txt_lines = [line.strip() for line in open(txt_file, 'r', encoding='utf-8')]
        # Perform your comparison/calculation between csv_df and txt_lines
        # --- End of custom processing ---

# Run the function with your directory paths
if __name__ == "__main__":
    process_matched_files("directory_A", "directory_B")

Key Details Explained #

• Pathlib for Path Handling: Path objects eliminate the need to manually handle OS-specific path separators (like / vs \), making your code more portable.
• Base Name Matching: file.stem extracts the file name without its extension—so a.txt becomes a, which matches a.csv perfectly.
• Intersection Check: Using set intersection (&) ensures we only process files that exist in both directories, avoiding errors from missing files.
• Custom Processing: The example code includes basic file reading—replace those sections with your actual calculation logic (e.g., comparing numerical values from the txt and csv, aggregating data, generating side-by-side reports).

Pro Tips #

• If you're working with large files, read them line-by-line instead of loading the entire content into memory to save resources.
• Add error handling (like try-except blocks) around file operations if you expect issues with file permissions or corrupted files.
• For complex data analysis, pandas will simplify working with CSV data and make comparisons with text file data much easier.

内容的提问来源于stack exchange，提问作者kRazzy R