如何使用Python循环实现两类fasta文件的批量拼接操作

Hey there! Let's break down how to handle both of your FASTA concatenation tasks with Python—these are super common workflows when dealing with large sequencing datasets, so loops will make this a breeze.

Scenario 1: Concatenating a range of sequentially named FASTA files #

First up, if you need to concatenate all files from 1R1.fasta up to 1000R1.fasta (adjust the loop range if your naming pattern differs) into a single combined output file, here's a straightforward approach:

# Define your final combined output file name
output_file = "all_sequences_combined.fasta"

# Open the output file in append mode to build it incrementally
with open(output_file, 'a') as outfile:
    # Loop through each number from 1 to 1000 (inclusive)
    for num in range(1, 1001):
        # Dynamically build the input file name
        input_filename = f"{num}R1.fasta"
        try:
            # Read each input file and write its content to the output
            with open(input_filename, 'r') as infile:
                outfile.write(infile.read())
                # Optional: Add a newline to avoid sequence overlap between files
                outfile.write('\n')
            print(f"Successfully added {input_filename} to {output_file}")
        except FileNotFoundError:
            print(f"Warning: {input_filename} not found, skipping this file...")

Quick Notes for This Scenario #

• If your files follow a pattern like 1R1.fasta, 1R2.fasta, ..., 1R1000.fasta (same prefix, varying R number), just tweak the filename line to f"1R{num}.fasta" and keep the loop range the same.
• The try/except block prevents the script from crashing if a file is missing, which is handy for large datasets where some files might be incomplete.

Scenario 2: Grouping and concatenating files by shared number prefix #

This is the targeted task: pairing 1R1.fasta, 1R2.fasta, 1R3.fasta into 1R.fasta, and repeating this for every number from 1 to 5000. Here's how to automate this efficiently:

# Set the range of numbers you need to process
start_num = 1
end_num = 5000

# Loop through each number group
for num in range(start_num, end_num + 1):
    # List all input files for the current number
    input_files = [f"{num}R1.fasta", f"{num}R2.fasta", f"{num}R3.fasta"]
    # Define the output file name for this group
    output_filename = f"{num}R.fasta"
    
    # Open the output file (overwrites if it already exists)
    with open(output_filename, 'w') as outfile:
        for file in input_files:
            try:
                with open(file, 'r') as infile:
                    outfile.write(infile.read())
                    outfile.write('\n')
                print(f"Added {file} to {output_filename}")
            except FileNotFoundError:
                print(f"Warning: {file} missing for number {num}, skipping...")
    print(f"Finished concatenation for {output_filename}\n")

Quick Notes for This Scenario #

• Use 'w' mode for the output file to create a fresh file each time. If you need to append to an existing file (e.g., re-running the script with new data), switch to 'a' mode instead.
• If you have more than 3 R files per number (e.g., R4, R5), just add them to the input_files list.

Pro Tips #

• If your FASTA files are stored in a separate folder, prepend the full path to your filenames (e.g., f"/home/yourname/sequencing_data/{num}R1.fasta").
• For extremely large files, reading the entire file at once with read() might use too much memory. Instead, read and write line by line to keep resource usage low:

  with open(file, 'r') as infile:
      for line in infile:
          outfile.write(line)
  

• To verify your outputs, count the number of sequence headers (lines starting with >) using a quick command like grep -c ">" {num}R.fasta (Linux/macOS) or a small Python snippet to cross-check with input file counts.

内容的提问来源于stack exchange，提问作者Megha