Python中高效拆分pandas DataFrame并自动定量命名的方法问询

Absolutely, splitting your DataFrame into 501 subsets based on the count column is totally feasible, and you can automate the naming process without manual work—let’s break this down:

a) Is this split possible, and how to implement it? #

Yes, this is absolutely doable using pandas' groupby() functionality, which is built for grouping data by categorical or numerical values. Since your count ranges from 1 to 501, grouping by this column will naturally create 501 distinct groups, each corresponding to a unique count value.

b) Automatically naming the sub-DataFrames #

While creating variables like df.1 isn’t valid in Python (variable names can’t start with a number), you have two solid options:

Option 1: Use a dictionary (Recommended) #

This is the cleanest and most maintainable approach. Store each sub-DataFrame in a dictionary where the key is the count value, and the value is the corresponding subset. This makes it easy to access, iterate, or modify subsets later.

# Initialize an empty dictionary to hold your sub-DataFrames
sub_dataframes = {}

# Group the original DataFrame by 'count' and populate the dictionary
for count_value, group in df.groupby('count'):
    # Optional: reset the index of each subset for cleaner output
    sub_dataframes[count_value] = group.reset_index(drop=True)

To access a specific subset (e.g., rows where count=501), just use:

sub_dataframes[501]

Option 2: Create named variables (Not recommended for large splits) #

If you really want individual variables like df_1, df_2, etc., you can use Python’s globals() function to dynamically create them. However, this is not ideal for 501 subsets because it clogs your namespace with hundreds of variables, making it hard to track or manage them.

# Warning: This can make your environment messy with 501 variables
for count_value, group in df.groupby('count'):
    # Create variables like df_1, df_2, ..., df_501
    globals()[f'df_{count_value}'] = group.reset_index(drop=True)

Key Notes #

• Your original DataFrame (168k rows) is small enough that this grouping process will run quickly without performance issues.
• Using the dictionary approach is best practice for large numbers of subsets—it keeps your code organized and avoids accidental variable overwrites.

内容的提问来源于stack exchange，提问作者raven