如何限制Microsoft Purview Unity Catalog扫描至指定Schema及特定表子集?
解决Microsoft Purview + Azure Databricks Unity Catalog 细粒度扫描筛选问题
核心解决方案:通过Purview REST API实现Schema与表级精准扫描配置
当前Purview UI对Unity Catalog扫描的筛选能力有限,直接调用REST API是实现指定Schema+含"bronze"表扫描的可靠方式,具体操作如下:
步骤1:构造扫描配置JSON payload
在payload中明确指定目标Catalog、需要扫描的Schema,同时添加表名称的包含筛选条件。示例结构:{ "properties": { "scanRulesetName": "AzureDatabricksUnityCatalog", "scanRulesetType": "System", "collection": { "referenceName": "你的集合名称", "type": "CollectionReference" }, "dataSource": { "referenceName": "你的Databricks Unity Catalog数据源名称", "type": "DataSourceReference" }, "scanTrigger": { "recurrence": null, "type": "OnDemand" }, "scope": { "assets": [ { "type": "Catalog", "referenceName": "dev" } ], "includeFilters": { "filterType": "Include", "filters": [ { "property": "schemaName", "operator": "In", "values": ["目标Schema1", "目标Schema2"] }, { "property": "tableName", "operator": "Contains", "values": ["bronze"] } ] } } } }步骤2:调用API创建/更新扫描
发送PUT请求到Purview扫描管理端点,替换占位符并携带Azure AD认证令牌:PUT https://{你的Purview账户名}.purview.azure.com/scans/{扫描名称}?api-version=2023-09-01步骤3:验证扫描结果
触发扫描后,在Purview资产页面确认仅同步了指定Schema下名称含"bronze"的表,确保筛选规则生效。
补充优化
如果需要批量管理多组扫描配置,可将上述API调用逻辑封装成PowerShell/Python脚本,实现自动化的扫描范围更新,提升治理效率。
内容的提问来源于stack exchange,提问作者RamAlx
相关产品推荐
相关产品推荐

