Python新手求助：如何将不同列表存入CSV且不覆盖已有内容

Hey there! I totally get this struggle—when you're running experiments with unique sequences per participant, the last thing you want is to lose previous data by overwriting the CSV. Let's break down two straightforward methods for you, whether you prefer using Python's built-in tools or a more user-friendly library like pandas.

Method 1: Using Python's Built-in csv Module #

This is great if you want to stick to standard libraries without installing extra packages.

• First, we'll open the CSV file in append mode (mode='a') instead of write mode (mode='w'), which ensures we add new rows instead of replacing the whole file.
• We'll also add a check to write a header only if the file is empty (so you don't duplicate headers every time you append).

Here's the code example tailored to your use case:

import csv

# Example data: your unique image sequence for participant 1
str_all = ["img_001.png", "img_005.png", "img_003.png"]
participant_id = 1  # Unique ID for each participant

# Open the CSV file in append mode
with open('participant_image_sequences.csv', mode='a', newline='', encoding='utf-8') as csv_file:
    writer = csv.writer(csv_file)
    
    # Check if the file is empty to write the header only once
    csv_file.seek(0)
    if not csv_file.read(1):
        writer.writerow(["participant_id", "image_sequence"])
    
    # Write the participant ID and their sequence (converted to a readable string)
    writer.writerow([participant_id, ', '.join(str_all)])

Key Notes: #

• newline='' prevents extra blank rows from being added between entries on Windows.
• Using ', '.join(str_all) turns your list into a clean comma-separated string—if you need to turn it back into a list later, just use sequence_str.split(', ') when reading the CSV.
• Always use a unique participant_id so you can map sequences back to specific users easily.

Method 2: Using pandas (Simpler for Batch or Regular Appends) #

If you're okay installing pandas (it's super useful for data tasks!), this method is more concise and handles headers automatically.

First, install pandas if you haven't already:

pip install pandas

Then use this code:

import pandas as pd
import os

# Example data
str_all = ["img_002.png", "img_004.png", "img_001.png"]
participant_id = 2

# Create a small DataFrame with your participant's data
data = {
    "participant_id": [participant_id],
    "image_sequence": [', '.join(str_all)]
}
df = pd.DataFrame(data)

# Append to CSV: header is only written if the file doesn't exist yet
df.to_csv(
    'participant_image_sequences.csv',
    mode='a',
    index=False,  # Don't write row numbers
    header=not os.path.exists('participant_image_sequences.csv'),
    encoding='utf-8'
)

Why This Works: #

• mode='a' tells pandas to append instead of overwrite.
• header=not os.path.exists(...) checks if the file exists—if not, it writes the header; if yes, it skips it.

Quick Tips to Avoid Headaches: #

• Test with a small sample first to make sure appending works before running your full experiment.
• If you need to store the list as a proper list (not a string), you can use json.dumps(str_all) when writing, and json.loads(sequence_str) when reading to convert it back.
• Keep your CSV file closed while running your script to prevent permission errors.

内容的提问来源于stack exchange，提问作者MD Claudio