如何自动查找含图片路径的7000+行TXT文件中的缺失行？

Got it, let's sort out this missing line detection problem for you. Your initial approach had a couple of flaws—like trying to match an integer directly against a string (which can lead to false matches, e.g., 1 would incorrectly match 10.png), and not properly extracting the actual image number from the file path.

Here's a cleaner, more reliable solution using regular expressions to accurately pull out the image numbers, then identifying gaps in the sequence:

Step-by-Step Explanation #

1. Extract Valid Numbers: Use regex to target the numeric part of the image filename (e.g., 1 from /.../1.png), ensuring we only grab the actual image ID instead of random numbers elsewhere in the path.
2. Track Existing IDs: Store these numbers in a set for O(1) lookups—critical for efficiency with 7000+ lines.
3. Find Gaps: Compare the full range of expected numbers (from 1 to the highest ID found) against the set of existing IDs to spot missing values.

Working Code #

import re

# Store all image numbers present in the file
existing_ids = set()

# Use 'with' to handle file I/O safely (auto-closes the file)
with open("data.txt", 'r') as file:
    for line in file:
        cleaned_line = line.strip()
        if not cleaned_line:
            continue  # Skip empty lines
        
        # Regex to capture the numeric part before .png at the end of the path
        match = re.search(r'/(\d+)\.png$', cleaned_line)
        if match:
            image_id = int(match.group(1))
            existing_ids.add(image_id)

if not existing_ids:
    print("No valid image entries found in the file.")
else:
    # Get the full range of expected IDs (assuming sequence starts at 1)
    min_id = 1
    max_id = max(existing_ids)
    
    # Find all IDs missing from the sequence
    missing_ids = [id_num for id_num in range(min_id, max_id + 1) if id_num not in existing_ids]
    
    if missing_ids:
        print("Missing image IDs (corresponding to missing lines):")
        for id_num in missing_ids:
            print(id_num)
    else:
        print("No missing lines detected—all image IDs in the sequence are present!")

Customization Notes #

• If your image sequence doesn't start at 1, replace min_id = 1 with min_id = min(existing_ids) to cover the actual starting point.
• If you want to generate the full expected line format for missing entries (e.g., guessing the label), you could add logic to map IDs to labels—but since labels vary, this would require more context (like knowing if IDs are split between normal/abnormal in a pattern).

内容的提问来源于stack exchange，提问作者Alex Nikitin