DeepDiff设置ignore_order=True未忽略顺序，求正确对比方案

问题场景 #

对比以下两个字典时，使用DeepDiff(data_a, data_b, ignore_order=True, get_deep_distance=True)未按预期忽略components数组的顺序，而是按索引位置报告差异，无法正确识别元素的增删或同类元素的版本变更。

待对比字典 #

数据A：

{
    "reg2/image2:0.1": {
        "binaries": {
            "/bin/xyz": {
                "components": [
                    "d",
                    "aa",
                    "new",
                    "git.example.com/wayform-chassis/xyzserver-v0.25.3"
                ],
                "md5": "8bf54c95f9"
            }
        },
        "loose_packages": []
    }
}

数据B：

{
    "reg2/image2:0.2": {
        "binaries": {
            "/bin/xyz": {
                "components": [
                    "c",
                    "git.example.com/wayform-chassis/xyzserver-v0.25.2",
                    "aa",
                    "asdhkjahsd"
                ],
                "md5": "f78f65f31"
            }
        },
        "loose_packages": ["test package"]
    }
}

解决方案 #

方案1：调整DeepDiff参数实现元素增删识别 #

get_deep_distance=True会计算深度差异距离，可能干扰ignore_order=True的顺序忽略逻辑。去掉该参数后，DeepDiff会将列表视为集合，正确识别元素的新增和删除：

from deepdiff import DeepDiff

# 定义数据（同上述数据A、B）

ddiff = DeepDiff(data_a, data_b, ignore_order=True)
print(ddiff)

输出会包含：

• iterable_added：新增的元素（c、asdhkjahsd、git.example.com/wayform-chassis/xyzserver-v0.25.2）
• iterable_removed：删除的元素（d、new、git.example.com/wayform-chassis/xyzserver-v0.25.3）
• 其他结构差异（如md5值变化、loose_packages新增元素、顶层键名变更）

方案2：自定义逻辑识别同类元素的版本变更 #

如果需要识别类似xyzserver的版本差异（将不同版本视为同一组件的变更而非不同元素），需自定义解析逻辑：

def compare_components(components_a, components_b):
    # 解析组件，分离基础名称与版本号
    def parse_comp(comp):
        if comp.startswith("git.example.com/wayform-chassis/"):
            base_name, version = comp.rsplit("-v", 1)
            return (base_name, version)
        return (comp, None)
    
    # 转换为基础名映射字典
    parsed_a = {base: ver for base, ver in map(parse_comp, components_a)}
    parsed_b = {base: ver for base, ver in map(parse_comp, components_b)}
    
    diffs = {}
    
    # 新增组件
    added = parsed_b.keys() - parsed_a.keys()
    if added:
        diffs["added_components"] = [f"{base}" + (f"-v{parsed_b[base]}" if parsed_b[base] else "") for base in added]
    
    # 删除组件
    removed = parsed_a.keys() - parsed_b.keys()
    if removed:
        diffs["removed_components"] = [f"{base}" + (f"-v{parsed_a[base]}" if parsed_a[base] else "") for base in removed]
    
    # 版本变更组件
    changed = []
    shared_bases = parsed_a.keys() & parsed_b.keys()
    for base in shared_bases:
        if parsed_a[base] != parsed_b[base]:
            changed.append(f"{base}: {parsed_a[base]} → {parsed_b[base]}")
    if changed:
        diffs["changed_components"] = changed
    
    return diffs

# 提取组件数组并对比
comp_a = data_a["reg2/image2:0.1"]["binaries"]["/bin/xyz"]["components"]
comp_b = data_b["reg2/image2:0.2"]["binaries"]["/bin/xyz"]["components"]
component_diffs = compare_components(comp_a, comp_b)

# 其他结构差异用DeepDiff处理
data_a_no_comp = data_a.copy()
data_a_no_comp["reg2/image2:0.1"]["binaries"]["/bin/xyz"].pop("components")
data_b_no_comp = data_b.copy()
data_b_no_comp["reg2/image2:0.2"]["binaries"]["/bin/xyz"].pop("components")
other_diffs = DeepDiff(data_a_no_comp, data_b_no_comp)

# 输出结果
print("组件差异：")
for k, v in component_diffs.items():
    print(f"- {k}: {v}")
print("\n其他结构差异：")
print(other_diffs)

输出示例：

组件差异：
- added_components: ['c', 'asdhkjahsd', 'git.example.com/wayform-chassis/xyzserver-v0.25.2']
- removed_components: ['d', 'new', 'git.example.com/wayform-chassis/xyzserver-v0.25.3']
- changed_components: ['git.example.com/wayform-chassis/xyzserver: 0.25.3 → 0.25.2']

其他结构差异：
{'values_changed': {"root['reg2/image2:0.1']['binaries']['/bin/xyz']['md5']": {'new_value': 'f78f65f31', 'old_value': '8bf54c95f9'}, "root['reg2/image2:0.1']['loose_packages']": {'new_value': ['test package'], 'old_value': []}}, 'dictionary_item_added': [root['reg2/image2:0.2']], 'dictionary_item_removed': [root['reg2/image2:0.1']]}

总结 #

• 仅需识别元素增删：使用DeepDiff(..., ignore_order=True)即可，无需get_deep_distance=True。
• 需要识别版本变更：结合自定义解析逻辑匹配同类元素，再用DeepDiff处理其他结构差异。

内容的提问来源于stack exchange，提问作者DarkSand