WordPress大分类CSV导入失败问题求助

Hey Alex, let’s break down this frustrating CSV import issue you’re hitting with WordPress category creation. I’ve tackled similar large-dataset problems before, so here’s what’s likely going on and how to fix it:

Why Only Partial Categories Are Being Created #

First, let’s address the core issue of incomplete categories:

• Duplicate Term Checks: WordPress’ wp_insert_term() function automatically checks if a term (category) already exists before creating it. If your CSV has duplicate category names/slugs, or if the check fails silently (e.g., due to encoding issues), those terms won’t be created.
• Hidden Errors: Even with increased PHP limits, your script might be hitting silent failures (like database deadlocks, invalid characters in category names, or slug collisions) that stop the import mid-process without throwing a visible error.

Why Splitting the CSV Made the Second Batch So Slow #

This is a classic database scaling issue:
When you ran the first batch, there were very few categories in the database, so the term_exists() check was fast. By the second batch, thousands of categories exist, and each check becomes a slower index lookup (or even a full table scan if indexes are missing). The cumulative delay adds up to that 10-minute runtime.

Fixes to Try (Ordered by Ease of Implementation) #

1. Cache Existing Terms Before Import #

The biggest win here is to avoid hitting the database for every single term check. Pre-fetch all existing category slugs into a PHP array, then check against that array instead:

// Run this ONCE before processing your CSV rows
$existing_cats = get_terms([
    'taxonomy' => 'category',
    'fields' => 'slugs', // Only fetch slugs to save memory
    'hide_empty' => false, // Include all categories, even empty ones
]);
$existing_cat_slugs = array_flip($existing_cats); // Flip for O(1) lookups

// Then, for each CSV row:
$new_cat_name = trim($row['category_name']);
$new_cat_slug = sanitize_title($new_cat_name);

if (!isset($existing_cat_slugs[$new_cat_slug])) {
    // Create the category only if it doesn't exist
    $result = wp_insert_term($new_cat_name, 'category', [
        'slug' => $new_cat_slug
    ]);
    
    // Add the new slug to our cache so we don't check the DB again
    if (!is_wp_error($result)) {
        $existing_cat_slugs[$new_cat_slug] = true;
    }
}

This cuts database queries from thousands to just one upfront, which will drastically speed up both batches.

2. Disable Unnecessary Hooks During Import #

Many plugins and themes hook into wp_insert_term to run extra logic (like syncing to external services, generating SEO metadata, or clearing caches). These add overhead for bulk imports. Temporarily disable them:

// Save the original hooks so we can restore them later
$original_insert_hooks = isset($GLOBALS['wp_filter']['wp_insert_term']) ? $GLOBALS['wp_filter']['wp_insert_term'] : [];

// Remove all actions/filters on wp_insert_term
remove_all_actions('wp_insert_term');
remove_all_filters('wp_insert_term');

// Run your full import process here...

// Restore the original hooks
$GLOBALS['wp_filter']['wp_insert_term'] = $original_insert_hooks;

3. Use WP-CLI for Bulk Imports (If Possible) #

If your server allows SSH access, WP-CLI is way more efficient than web-based scripts. It avoids HTTP timeouts, uses fewer resources, and has built-in tools for bulk operations. For example, you can use the wp term create command in a loop, or install a CSV import plugin that supports WP-CLI.

4. Clean Up Your CSV Data #

• Remove duplicate category entries (use a spreadsheet tool like Excel/Google Sheets to find duplicates).
• Sanitize category names: Remove special characters, line breaks, or leading/trailing whitespace that might cause slug collisions or encoding errors.
• Ensure slug uniqueness: If two categories have similar names, manually set unique slugs in the CSV to avoid WordPress auto-generating duplicates.

5. Optimize Database Indexes #

Double-check that your wp_terms table has proper indexes for fast lookups. Run this MySQL query to verify:

SHOW INDEX FROM wp_terms;

If the slug column doesn’t have a unique index, add it with:

ALTER TABLE wp_terms ADD UNIQUE INDEX slug (slug);

This makes the term_exists() check much faster even with large numbers of categories.

Final Notes #

After implementing the cached terms fix, you should be able to import the full CSV (even as a single file) without partial category issues or slowdowns. If you still see partial imports, enable WordPress debug mode to catch hidden errors:

// Add this to wp-config.php temporarily
define('WP_DEBUG', true);
define('WP_DEBUG_LOG', true);

Check wp-content/debug.log after running the import to see if any errors are stopping the process.

内容的提问来源于stack exchange，提问作者Alex