Elasticsearch query_string检索时自定义停用词不生效问题

核心需求 #

• 检索时同时过滤通用停用词与自定义排除词
• 若检索词属于排除列表（如已加入停用词表的comedy），直接返回空结果
• 停用词表内的所有词，无论在哪个字段匹配到，都不能触发结果返回
• 普通非停用词检索正常返回匹配结果，例如搜索Jennifer时需返回对应匹配数据
• 查询必须使用query_string语法实现
• 解决当前配置下搜索and仍返回结果的异常问题

测试样例数据 #

[
  {
    "id": 0,
    "Title": "Live1",
    "US Gross": 146083,
    "Worldwide Gross": 146083,
    "US DVD Sales": null,
    "Production Budget": 8000000,
    "Release Date": "Jun 12 1998",
    "MPAA Rating": "R",
    "Running Time min": null,
    "Distributor": "Gramercy",
    "Source": null,
    "Major Genre": "Comedy",
    "Creative Type": null,
    "Director": "T and I",
    "Rotten Tomatoes Rating": null,
    "IMDB Rating": 6.1,
    "IMDB Votes": 1071
  },
  {
    "id": 1,
    "Title": "First Love, Last Rites",
    "US Gross": 10876,
    "Worldwide Gross": 10876,
    "US DVD Sales": null,
    "Production Budget": 300000,
    "Release Date": "Aug 07 1998",
    "MPAA Rating": "R",
    "Running Time min": null,
    "Distributor": "Strand",
    "Source": null,
    "Major Genre": "Drama",
    "Creative Type": null,
    "Director": "Richard Jennifer",
    "Rotten Tomatoes Rating": null,
    "IMDB Rating": 6.9,
    "IMDB Votes": 207
  }
]

当前失效配置 #

索引Settings配置 #

{
  "settings": {
    "analysis": {
      "analyzer": {
        "blogs_analyzer": {
          "type": "standard",
          "stopwords": ["and", "is", "comedy"]
        }
      }
    }
  }
}

现有查询DSL #

{
  "query": {
    "bool": {
      "must": {
        "query_string": {
          "query": "and",
          "fields": ["Title^24", "Major Genre^8", "Director^2"]
        }
      }
    }
  }
}

失效原因 #

自定义的blogs_analyzer未绑定到检索涉及的三个字段上，Elasticsearch默认text字段使用不带自定义停用词的标准分析器，写入数据分词、查询时分词都不会走配置的停用词过滤逻辑，导致配置完全不生效。

修复方案 #

1. 删除原有失效索引，用包含字段映射的新配置重建索引，确保检索字段的写入分词器、搜索分词器都指定为带停用词配置的blogs_analyzer
2. 重新导入全量测试数据
3. query_string查询时显式指定分析器做兜底，避免字段配置遗漏

正确的索引配置 #

{
  "settings": {
    "analysis": {
      "analyzer": {
        "blogs_analyzer": {
          "type": "standard",
          "stopwords": ["and", "is", "comedy"]
        }
      }
    }
  },
  "mappings": {
    "properties": {
      "Title": {
        "type": "text",
        "analyzer": "blogs_analyzer",
        "search_analyzer": "blogs_analyzer"
      },
      "Major Genre": {
        "type": "text",
        "analyzer": "blogs_analyzer",
        "search_analyzer": "blogs_analyzer"
      },
      "Director": {
        "type": "text",
        "analyzer": "blogs_analyzer",
        "search_analyzer": "blogs_analyzer"
      }
    }
  }
}

注意：Elasticsearch不支持修改已有字段的分析器配置，必须重建索引才能让分析器配置生效。

验证查询 #

1. 搜索停用词and，返回空结果：

{
  "query": {
    "bool": {
      "must": {
        "query_string": {
          "query": "and",
          "fields": ["Title^24", "Major Genre^8", "Director^2"],
          "analyzer": "blogs_analyzer"
        }
      }
    }
  }
}

2. 搜索自定义排除词comedy，返回空结果
3. 搜索普通词Jennifer，正常返回id=1的匹配文档：

{
  "query": {
    "bool": {
      "must": {
        "query_string": {
          "query": "Jennifer",
          "fields": ["Title^24", "Major Genre^8", "Director^2"],
          "analyzer": "blogs_analyzer"
        }
      }
    }
  }
}

内容的提问来源于stack exchange，提问作者sim