如何在Kusto查询中计算Azure Blob存储全链路处理时长?
调整后的Kusto查询及说明
首先先修正原查询的逻辑漏洞:原查询的where条件中and优先级高于or,会导致过滤逻辑不符合预期,先给URI匹配部分加括号修复。
然后新增操作分类、时间节点聚合逻辑,直接输出总时长,完整代码如下:
//==================================================// // Assign variables //==================================================// let varStart = ago(2d); let varEnd = now(); let varStorageAccount = 'stgaccountname'; let varSampleUploadUri = 'https://stgaccountname.dfs.core.windows.net/containername/filename.csv'; let varSampleDownloadUri = replace(@'%2F', @'/', replace(@'.dfs.', @'.blob.', tostring(varSampleUploadUri))); // 可按需调整上传操作的匹配列表,更精准过滤 let uploadOperations = dynamic(['CreatePathFile', 'LeaseFile', 'AppendFile', 'FlushFile']); //==================================================// // Filter table //==================================================// StorageBlobLogs | where TimeGenerated between (varStart .. varEnd) and AccountName == varStorageAccount // 修复原逻辑优先级错误,给URI条件加括号 and (split(Uri, '?')[0] == varSampleUploadUri or split(Uri, '?')[0] == varSampleDownloadUri) // 只保留成功的操作避免错误请求干扰统计,不需要可以注释掉 and StatusCode between (200..299) //==================================================// // 计算总时长 //==================================================// | summarize FirstUploadTime = minif(TimeGenerated, OperationName in (uploadOperations)), LastDownloadTime = maxif(TimeGenerated, OperationName == 'GetBlob') | extend TotalProcessDuration = LastDownloadTime - FirstUploadTime // 可选:格式化时长为易读的天/小时/分钟/秒格式 | extend TotalProcessDuration = format_timespan(TotalProcessDuration, 'd.hh:mm:ss.ff')
如果你需要同时保留原有的操作明细列表,还要显示总时长,可以用materialize函数缓存过滤后的结果,分别查询明细和总时长,代码如下:
//==================================================// // Assign variables //==================================================// let varStart = ago(2d); let varEnd = now(); let varStorageAccount = 'stgaccountname'; let varSampleUploadUri = 'https://stgaccountname.dfs.core.windows.net/containername/filename.csv'; let varSampleDownloadUri = replace(@'%2F', @'/', replace(@'.dfs.', @'.blob.', tostring(varSampleUploadUri))); let uploadOperations = dynamic(['CreatePathFile', 'LeaseFile', 'AppendFile', 'FlushFile']); // 缓存过滤后的日志数据 let filteredLogs = materialize( StorageBlobLogs | where TimeGenerated between (varStart .. varEnd) and AccountName == varStorageAccount and (split(Uri, '?')[0] == varSampleUploadUri or split(Uri, '?')[0] == varSampleDownloadUri) and StatusCode between (200..299) ); // 输出操作明细 filteredLogs | summarize count() by OperationName, TimeGenerated, UserAgent = tostring(split(UserAgentHeader, ' ')[0]), ChunkSize = iif(OperationName == 'GetBlob', format_bytes(ResponseBodySize, 2, 'MB'), format_bytes(RequestBodySize, 2, 'MB')), StatusCode, StatusText | order by TimeGenerated asc // 联合输出总时长 union ( filteredLogs | summarize FirstUploadTime = minif(TimeGenerated, OperationName in (uploadOperations)), LastDownloadTime = maxif(TimeGenerated, OperationName == 'GetBlob') | extend TotalProcessDuration = format_timespan(LastDownloadTime - FirstUploadTime, 'd.hh:mm:ss.ff') | project OperationName = '=== 总统计 ===', TimeGenerated = LastDownloadTime, ChunkSize = '', UserAgent = '', StatusCode = '', StatusText = strcat('总时长: ', TotalProcessDuration, ' 首上传时间: ', FirstUploadTime, ' 末下载时间: ', LastDownloadTime) ) | order by TimeGenerated asc
补充说明
- 上述查询默认只统计成功的请求,如果需要包含失败的请求,把
StatusCode between (200..299)这行注释掉即可 uploadOperations列表可以根据你实际的上传操作类型调整,避免其他无关操作干扰首上传时间的统计
内容的提问来源于stack exchange,提问作者ericOnline
相关产品推荐
相关产品推荐

