Python（Anaconda Spyder）文本数据格式转换问题求助

I’ve run into similar issues with tab-separated RLGC files before—let’s break down how to fix this properly. The core problem is usually unhandled headers, inconsistent whitespace (tabs/spaces mixed), or invalid lines in the input file. Here are two reliable approaches tailored to your Python 3.6.4 environment:

1. Pure Python Approach (No Pandas Dependency) #

This gives you full control over parsing without relying on dataframes, and handles mixed tabs/spaces while skipping non-numeric lines automatically.

input_path = "your_rlgc_input.txt"
output_path = "formatted_rlgc_output.txt"

# Define your desired output format (adjust decimal places as needed)
output_template = "{freq:.2e}\t{R:.4e}\t{L:.4e}\t{G:.4e}\t{C:.4e}\n"

with open(input_path, "r") as infile, open(output_path, "w") as outfile:
    for line_num, line in enumerate(infile, 1):
        stripped_line = line.strip()
        
        # Skip empty lines or lines starting with non-numeric characters (headers/comments)
        if not stripped_line or not (stripped_line[0].isdigit() or stripped_line[0] == "-"):
            continue
        
        # Split line into parts (handles tabs, spaces, or any mix of whitespace)
        data_parts = stripped_line.split()
        
        # Ensure we have exactly 5 values (Freq, R, L, G, C)
        if len(data_parts) != 5:
            print(f"Skipping line {line_num}: Incorrect number of values ({len(data_parts)})")
            continue
        
        # Convert to floats with error handling
        try:
            freq = float(data_parts[0])
            R = float(data_parts[1])
            L = float(data_parts[2])
            G = float(data_parts[3])
            C = float(data_parts[4])
        except ValueError as e:
            print(f"Skipping line {line_num}: Invalid numeric value. Error: {e}")
            continue
        
        # Write formatted line to output
        outfile.write(output_template.format(freq=freq, R=R, L=L, G=G, C=C))

print(f"Processing complete! Output saved to {output_path}")

Key Fixes Here: #

• Uses split() without arguments to handle any combination of tabs/spaces (no need to specify \t explicitly).
• Skips non-numeric lines (like headers starting with "Frequency") which were causing your NaN issues.
• Adds error handling for invalid lines so your script doesn’t crash mid-processing.

2. Pandas Approach (For Quick Data Manipulation) #

If you prefer using pandas (common in Anaconda environments), this method is concise but requires careful handling of headers and delimiters:

import pandas as pd

input_path = "your_rlgc_input.txt"
output_path = "formatted_rlgc_output.txt"

# Read the file: use \s+ to handle tabs/spaces, skip header rows (adjust skiprows as needed)
# Replace skiprows=1 with the number of header lines in your file
df = pd.read_csv(
    input_path,
    sep="\s+",
    skiprows=1,  # Skip 1 header line (modify if your file has more)
    header=None,
    names=["Frequency", "R", "L", "G", "C"]
)

# Convert all columns to numeric, coercing invalid values to NaN
df = df.apply(pd.to_numeric, errors="coerce")

# Drop any rows with NaN values (invalid lines)
df = df.dropna()

# Write to output with desired formatting
df.to_csv(
    output_path,
    sep="\t",
    index=False,
    float_format="%.4e"  # Adjust decimal places here
)

print(f"Conversion finished! Output at {output_path}")

Why Your Previous Pandas Attempt Failed: #

• You likely didn’t skip header lines, so the first row (string headers) was being passed to pd.to_numeric, resulting in NaNs for the first column.
• Using sep="\t" alone might fail if some lines use spaces instead of tabs—sep="\s+" fixes this by matching any whitespace.

Troubleshooting Tips: #

• Check Your Input File: Open it in a text editor to confirm if there are header lines, comments (starting with #), or empty lines. Adjust the skip logic accordingly.
• Test with a Small Sample: Take your 3-line example and run the script on it first to verify formatting works as expected.
• Adjust Output Format: Modify the output_template (pure Python) or float_format (pandas) to match your exact required format (e.g., more/less decimal places, different separators).

内容的提问来源于stack exchange，提问作者aguntuk