Pandas SettingWithCopyWarning警告问题排查与解决求助

我编写了一段用于处理DataFrame的for循环代码，遍历行索引生成关键词字典后，将其赋值给unique_new_articles的keywords列，代码如下：

for n in range(df_length):
    keywords_list = []
    keywords_dict = {}

    try:
        text_for_ner = str(str(unique_new_articles['first_para'][n].split("--",1)[1] + "\n" + unique_new_articles['headline'][n]))
    except:
        pass

    doc = nlp(text_for_ner)

    for token in doc.ents:
        if token.label_ in ['GPE', 'LOC', 'ORG', 'PRODUCT', 'FAC', 'NORP', 'PERSON', 'EVENT', 'LAW', 'WORK_OF_ART']:
            keywords_list.append(str(token))

    keywords_list = [word.replace('the ', '') if word.startswith('the') else word for word in keywords_list]
    keywords_list = [word.replace('The ', '') if word.startswith('The') else word for word in keywords_list]
    keywords_list = [word.replace("'s", "") if word.endswith("'s") else word for word in keywords_list]
    keywords_list = [word.replace("'", "") if word.endswith("s'") else word for word in keywords_list]

    keywords_dict = Counter(keywords_list)
        
    unique_new_articles['keywords'][n] = keywords_dict

运行时出现如下警告：

A value is trying to be set on a copy of a slice from a DataFrame

See the caveats in the documentation:
https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
unique_new_articles['keywords'][n] = keywords_dict

测试发现小数据集（10行）无此警告，但处理6000+行的完整数据集时会触发，怀疑和内存处理方式或链式索引有关，需要解决思路。

• 修复链式索引问题：unique_new_articles['keywords'][n]属于链式索引（先取列再取行），Pandas无法确定你操作的是原DataFrame还是副本，改成用.loc进行单步索引即可消除警告：

  unique_new_articles.loc[n, 'keywords'] = keywords_dict
  

• 确认DataFrame是否为视图：如果unique_new_articles是从其他DataFrame切片得到的（比如df[df['col'] > 0]这类操作），Pandas可能返回的是视图而非独立副本。可以显式创建副本避免视图修改问题：

  unique_new_articles = unique_new_articles.copy()
  

• 替换低效循环为apply方法：Pandas不推荐逐行循环处理大数据集，效率极低。可以重构为apply方法，定义单行处理函数后批量执行，既解决索引问题又提升速度：

  from collections import Counter
  import spacy
  
  nlp = spacy.load("en_core_web_sm")
  
  def extract_keywords(row):
      keywords_list = []
      try:
          # 提取文本
          first_para_part = row['first_para'].split("--", 1)[1]
          text_for_ner = f"{first_para_part}\n{row['headline']}"
      except IndexError:
          # 处理没有分割符的情况
          text_for_ner = row['headline']
      
      doc = nlp(text_for_ner)
      # 筛选指定实体
      allowed_labels = {'GPE', 'LOC', 'ORG', 'PRODUCT', 'FAC', 'NORP', 'PERSON', 'EVENT', 'LAW', 'WORK_OF_ART'}
      keywords_list = [str(token) for token in doc.ents if token.label_ in allowed_labels]
      
      # 清洗关键词
      cleaned = []
      for word in keywords_list:
          if word.startswith('the '):
              cleaned.append(word[4:])
          elif word.startswith('The '):
              cleaned.append(word[4:])
          elif word.endswith("'s"):
              cleaned.append(word[:-2])
          elif word.endswith("s'"):
              cleaned.append(word[:-2])
          else:
              cleaned.append(word)
      
      return Counter(cleaned)
  
  # 批量生成关键词列
  unique_new_articles['keywords'] = unique_new_articles.apply(extract_keywords, axis=1)
  

• 修复异常处理逻辑：原代码的except: pass会吞掉所有异常，可能导致text_for_ner未定义而触发后续报错。应该明确捕获特定异常（比如IndexError，对应分割失败的情况），并给出默认处理逻辑。

内容的提问来源于stack exchange，提问作者KCpremo