无法使用数据流时,如何在ADF中展平Cost Management API的JSON数据?
问题:Azure Data Factory处理Cost Management API返回JSON的rows数组转换需求
在Azure Data Factory(ADF)项目中处理Cost Management API返回的JSON数据,通过复制数据活动获取到的JSON结构如下:
{ "id": "id1", "name": "name1", "type": "Microsoft.CostManagement/query", "location": null, "sku": null, "eTag": null, "properties": { "nextLink": "https://management.azure.com/providers/Microsoft.Billing/billingAccounts/billingid1", "columns": [ { "name": "Cost", "type": "Number" }, { "name": "UsageDate", "type": "Number" }, { "name": "ResourceId", "type": "String" }, { "name": "ServiceName", "type": "String" }, { "name": "Currency", "type": "String" } ], "rows": [ [1, 20241101, "subscription1", "Microsoft Defender for Cloud", "EUR"], [2, 20241101, "subscription2", "Microsoft Defender for Cloud", "EUR"] ] } }
仅关注其中的rows数组,希望将每个子数组转为CSV或Parquet文件中的单独行,每个子项对应一列,预期输出如下:
| Column1 | Column2 | Column3 | Column4 | Column5 |
|---|---|---|---|---|
| 1 | 20241101 | subscription1 | Microsoft Defender for Cloud | EUR |
| 2 | 20241101 | subscription2 | Microsoft Defender for Cloud | EUR |
由于无法使用ADF数据流,尝试过复制数据活动的“映射”选项但未得到正确结果,还通过筛选活动用表达式@activity('web1').output.properties.rows提取了rows数据,但无法将其设为复制数据活动的源,恳请提供其他ADF组件的解决方案。
内容的提问来源于stack exchange,提问作者user12152641
相关产品推荐
相关产品推荐

