如何在Python中使用正则表达式去除列表重复元素（不使用集合操作）

Great question! Since regex operates on string data, we can leverage it along with a stateful substitution function to deduplicate your list without using the set data structure directly. Here's how to do it step by step:

Solution Code #

import re
import ast

original_list = ["name1", "name2", "name3", "name4", "name1", "name2", "name3", "name4"]
list_str = str(original_list)

# Track seen elements with a list (avoiding set as requested)
seen = []

def keep_first_occurrence(match):
    element = match.group(1)
    if element in seen:
        # Replace duplicate with empty string
        return ""
    # Keep the first occurrence and mark it as seen
    seen.append(element)
    return match.group(0)

# Regex pattern to match each string element (with optional comma/space after)
pattern = r"'([^']+)',?\s*"
processed_str = re.sub(pattern, keep_first_occurrence, list_str)

# Clean up any trailing comma before the closing bracket
processed_str = re.sub(r",\s*]", "]", processed_str)

# Convert the cleaned string back to a list safely
deduped_list = ast.literal_eval(processed_str)

print(deduped_list)
# Output: ['name1', 'name2', 'name3', 'name4']

How It Works #

1. Convert List to String: We first turn the list into its string representation so regex can process it.
2. Stateful Substitution: The keep_first_occurrence function works with re.sub to track elements we've already seen using a list. It keeps the first occurrence of each element and replaces duplicates with an empty string.
3. Regex Pattern: The pattern r"'([^']+)',?\s*" matches each quoted string element, along with any trailing comma and space (so we can remove the entire duplicate entry, not just the element itself).
4. Clean Up: After substitution, we remove any leftover trailing comma to ensure the string is a valid list representation.
5. Convert Back to List: Using ast.literal_eval safely converts the cleaned string back into a proper Python list (safer than using eval directly).

This approach maintains the original order of first occurrences and avoids using set operations as requested.

内容的提问来源于stack exchange，提问作者himabindu