在Pandas中将列表格式字符串转换为列表的方法

Hey there! Let's fix that frustrating issue where your Pandas column stores list-like values as strings instead of actual lists. Here are a few reliable methods to convert them into operable list types:

方法1：使用ast.literal_eval()（推荐方案） #

This is the safest and most robust option because it parses valid Python literals (like lists, dictionaries, tuples) without executing arbitrary code (unlike the risky eval() function).

步骤： #

1. 导入ast模块
2. 用apply()将literal_eval应用到目标列

import ast
import pandas as pd

# 假设你的DataFrame是df，目标列名为'list_column'
df['list_column'] = df['list_column'].apply(ast.literal_eval)

After running this, you can verify the type with:

print(type(df['list_column'].iloc[0]))  # 应该输出 <class 'list'>

Now you can use all standard list operations like extend(), append(), or list comprehensions on the column values!

方法2：手动字符串处理（仅适用于简单、固定格式） #

If your string lists have a super consistent format (no commas inside list items, no mixed quotes), you can manually strip and split the strings. Note this is less reliable for complex cases.

df['list_column'] = df['list_column'].str.strip('[]')  # 去掉首尾的方括号
df['list_column'] = df['list_column'].str.split(', ')  # 按逗号+空格分割
# 去掉每个元素的单引号
df['list_column'] = df['list_column'].apply(lambda x: [item.strip("'") for item in x])

⚠️ 注意：如果你的列表元素包含逗号（比如"hello, world"）或者嵌套引号，这个方法会失效，所以除非你百分百确定格式规则，否则优先用ast.literal_eval。

方法3：使用json.loads()（需要格式调整） #

JSON uses double quotes for strings, so if you first replace all single quotes with double quotes, you can use json.loads to parse the string into a list.

import json

df['list_column'] = df['list_column'].str.replace("'", '"').apply(json.loads)

Again, this has limitations: if any list item contains double quotes, this will fail. ast.literal_eval handles both single and double quotes seamlessly, making it the better all-around choice.

内容的提问来源于stack exchange，提问作者Baktaawar